2023-09-29T15:41:53.578 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T15:41:53.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:41:53.714 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f48c14dd670>, signals=[15]) 2023-09-29T15:41:53.714 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-09-29T15:41:53.715 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T15:41:53.715 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-09-29T15:41:53.739 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-09-29T15:41:53.739 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T15:41:53.739 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-09-29T15:41:53.741 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-09-29T15:41:53.764 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-09-29T15:41:53.824 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-29T15:41:53.836 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-29T15:41:53.863 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_8.stream (ID 3) 2023-09-29T15:41:53.863 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 3} 2023-09-29T15:41:53.881 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_8.stream (ID 3) 2023-09-29T15:41:53.881 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 3} 2023-09-29T15:41:53.910 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream 2023-09-29T15:41:53.911 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:41:53.919 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream 2023-09-29T15:41:53.919 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:41:53.982 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T15:41:53.986 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T15:41:54.020 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-09-29T15:41:54.023 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-09-29T15:41:54.072 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:41:54.075 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:41:54.177 INFO:teuthology.orchestra.console.smithi167:Power off 2023-09-29T15:41:54.177 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T15:41:54.190 INFO:teuthology.orchestra.console.smithi003:Power off 2023-09-29T15:41:54.190 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T15:41:54.199 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-09-29T15:41:54.199 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:41:54.211 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-09-29T15:41:54.211 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:41:54.219 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-29T15:41:54.241 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-29T15:41:58.220 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:41:58.243 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:41:58.328 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-29T15:41:58.353 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-29T15:42:02.330 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:02.355 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:02.441 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-29T15:42:02.463 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-29T15:42:06.446 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:06.481 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:06.584 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-09-29T15:42:06.597 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-29T15:42:06.685 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-09-29T15:42:06.698 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-09-29T15:42:06.786 INFO:teuthology.orchestra.console.smithi167:Power on 2023-09-29T15:42:06.787 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T15:42:06.799 INFO:teuthology.orchestra.console.smithi003:Power on 2023-09-29T15:42:06.799 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T15:42:06.808 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-09-29T15:42:06.808 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:06.823 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-09-29T15:42:06.824 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:06.833 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-09-29T15:42:06.847 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-29T15:42:10.838 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:10.848 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:10.947 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-09-29T15:42:10.960 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-29T15:42:11.048 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-09-29T15:42:11.166 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-09-29T15:42:11.168 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:42:14.962 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T15:42:15.071 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-09-29T15:42:15.172 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-09-29T15:42:15.273 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-09-29T15:42:15.273 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:42:26.266 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:42:30.366 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:42:41.374 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:42:45.459 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:42:56.474 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:43:00.546 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:43:11.574 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:43:15.650 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:43:26.685 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:43:30.754 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:43:41.782 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:43:45.862 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:43:56.878 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:44:00.926 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:44:11.978 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:44:16.018 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:44:27.073 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:44:31.102 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:44:42.161 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:44:46.291 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-09-29T15:44:46.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:44:49.435 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-29T15:44:55.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:44:57.244 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-09-29T15:44:57.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:44:58.490 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-29T15:45:00.382 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:45:04.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:06.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:07.550 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-29T15:45:09.466 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:45:13.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:15.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:16.862 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-29T15:45:18.522 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:45:22.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:24.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:25.946 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-29T15:45:27.582 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:45:31.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:33.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:35.002 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-09-29T15:45:36.670 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:45:41.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:42.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:45.854 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:45:51.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:45:54.938 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-09-29T15:46:00.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:46:41.047 WARNING:teuthology.provision.fog.smithi003:timed out 2023-09-29T15:46:47.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:46:47.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-29T15:46:47.328 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-29T15:46:47.619 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-09-29T15:46:47.620 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-09-29T15:46:47.642 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-09-29T15:46:47.643 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-09-29T15:46:47.705 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-09-29T15:46:47.706 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-09-29T15:46:47.811 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-09-29T15:46:47.843 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-09-29T15:46:47.915 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-09-29T15:46:47.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-09-29T15:46:48.055 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-09-29T15:46:48.114 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-09-29T15:46:48.114 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2023-09-29T15:46:48.114 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-09-29T15:46:48.114 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T15:46:48.115 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T15:46:48.116 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-09-29T15:46:48.117 DEBUG:teuthology.parallel:result is None 2023-09-29T15:47:00.958 WARNING:teuthology.provision.fog.smithi167:timed out 2023-09-29T15:47:06.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:47:07.242 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-29T15:47:07.242 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-29T15:47:07.510 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-09-29T15:47:07.511 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-09-29T15:47:07.530 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-09-29T15:47:07.530 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-09-29T15:47:07.589 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-09-29T15:47:07.590 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-09-29T15:47:07.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-09-29T15:47:07.731 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-09-29T15:47:07.800 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-09-29T15:47:07.868 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-09-29T15:47:07.936 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T15:47:07.994 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-09-29T15:47:07.995 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T15:47:07.995 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-09-29T15:47:07.995 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T15:47:07.995 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T15:47:07.995 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T15:47:07.995 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-09-29T15:47:07.996 DEBUG:teuthology.parallel:result is None 2023-09-29T15:47:08.148 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-09-29T15:47:08.148 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-29T15:47:08.172 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-09-29T15:47:08.172 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-29T15:47:08.190 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-09-29T15:47:08.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-09-29T15:47:08.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:47:08.299 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-09-29T15:47:08.438 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-09-29T15:47:08.438 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-09-29T15:47:08.497 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-09-29T15:47:08.498 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-09-29T15:47:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-09-29T15:47:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2023-09-29T15:47:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-09-29T15:47:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-09-29T15:47:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2023-09-29T15:47:08.559 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T15:47:08.560 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T15:47:08.561 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-09-29T15:47:08.580 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-09-29T15:47:08.580 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-09-29T15:47:08.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-29T15:47:08.650 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-09-29T15:47:08.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-09-29T15:47:08.727 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-09-29T15:47:08.779 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-09-29T15:47:08.779 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-09-29T15:47:08.837 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-29T15:47:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-29T15:47:08.884 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-29T15:47:08.884 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-09-29T15:47:08.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:47:09.008 INFO:teuthology.dispatcher.supervisor:Running job 7405411 2023-09-29T15:47:09.008 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405411 --name yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405411/orig.config.yaml 2023-09-29T15:47:09.021 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405411 2023-09-29T15:47:09.037 INFO:teuthology.dispatcher.supervisor:Job PID: 1037571 2023-09-29T15:47:09.037 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-29T15:49:09.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:51:09.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:53:09.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:55:09.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:57:09.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T15:59:10.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:01:10.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:03:10.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:05:10.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:07:10.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:09:10.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:11:11.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:13:11.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T16:13:11.249 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-29T16:13:11.393 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-29T16:13:11.393 INFO:teuthology.nuke:Checking targets against current locks 2023-09-29T16:13:11.443 DEBUG:teuthology.nuke:shortname: smithi003 2023-09-29T16:13:11.443 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T16:13:11.470 DEBUG:teuthology.nuke:shortname: smithi167 2023-09-29T16:13:11.470 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-29T16:13:11.478 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 15:41:52.727685', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPsLOoMO78PuWpDeDQsYLkv9PlwoHlBkACW0v6r57RY7PL4mDXcGH+A5HTlypqcLhFiJEiDR0F90Xmfhgp+5WfQ='} 2023-09-29T16:13:11.492 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405411', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 15:41:52.729653', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBITzFPlFMdCXGTqvlQ63y1zosyyVMj0rqcKvx1xRNdFB+b9OpA85rT4R1nsv9KsvXicDiPfb5PhNdT4Lhft2cIA='} 2023-09-29T16:13:11.533 INFO:teuthology.orchestra.console.smithi003:Power off 2023-09-29T16:13:11.534 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T16:13:11.555 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-09-29T16:13:11.556 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:13:11.571 INFO:teuthology.orchestra.console.smithi167:Power off 2023-09-29T16:13:11.571 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T16:13:11.578 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-09-29T16:13:11.592 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-09-29T16:13:11.593 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T16:13:11.617 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-09-29T16:13:11.680 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-09-29T16:13:11.718 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-09-29T16:13:11.842 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-09-29T16:13:11.865 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com