2023-09-11T14:25:03.681 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-11T14:25:03.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:25:03.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb20724c670>, signals=[15]) 2023-09-11T14:25:03.815 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-09-11T14:25:03.816 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T14:25:03.816 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-09-11T14:25:03.839 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-09-11T14:25:03.839 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T14:25:03.840 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-09-11T14:25:03.841 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-09-11T14:25:03.864 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-09-11T14:25:03.912 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-11T14:25:03.921 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-11T14:25:03.945 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2023-09-11T14:25:03.945 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 10} 2023-09-11T14:25:03.967 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2023-09-11T14:25:03.968 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 10} 2023-09-11T14:25:03.988 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2023-09-11T14:25:03.989 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:25:04.013 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2023-09-11T14:25:04.013 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:25:04.034 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T14:25:04.062 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T14:25:04.066 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-09-11T14:25:04.099 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-09-11T14:25:04.120 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:25:04.166 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:25:04.207 INFO:teuthology.orchestra.console.smithi098:Power off 2023-09-11T14:25:04.208 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T14:25:04.231 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-09-11T14:25:04.231 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:04.253 INFO:teuthology.orchestra.console.smithi105:Power off 2023-09-11T14:25:04.254 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T14:25:04.262 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-09-11T14:25:04.275 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-09-11T14:25:04.275 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:04.297 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-11T14:25:08.266 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:08.298 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:08.376 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-09-11T14:25:08.407 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-11T14:25:12.378 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:12.408 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:12.487 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-09-11T14:25:12.517 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-11T14:25:16.491 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:16.518 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:16.600 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-11T14:25:16.627 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-11T14:25:16.701 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-09-11T14:25:16.728 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-09-11T14:25:16.803 INFO:teuthology.orchestra.console.smithi098:Power on 2023-09-11T14:25:16.803 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T14:25:16.824 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2023-09-11T14:25:16.824 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:16.834 INFO:teuthology.orchestra.console.smithi105:Power on 2023-09-11T14:25:16.834 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T14:25:16.848 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-11T14:25:16.854 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-09-11T14:25:16.854 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:16.874 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-11T14:25:20.850 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:20.876 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:20.960 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2023-09-11T14:25:20.984 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-11T14:25:21.061 INFO:teuthology.orchestra.console.smithi098:Power on completed 2023-09-11T14:25:21.162 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-09-11T14:25:21.162 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:25:24.989 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:25:25.098 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-09-11T14:25:25.199 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-09-11T14:25:25.299 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-09-11T14:25:25.300 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:25:36.230 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:25:40.378 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:25:51.297 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:25:55.434 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:26:06.374 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:26:10.502 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:26:21.446 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:26:25.574 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:26:36.518 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:26:40.646 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:26:51.588 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:26:55.710 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:27:06.658 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:27:10.782 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:27:21.726 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:27:25.852 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:27:36.798 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:27:40.902 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:27:51.867 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:27:55.970 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-11T14:27:56.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:27:59.098 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:05.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:06.925 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-09-11T14:28:06.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:08.154 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:10.042 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-11T14:28:14.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:16.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:17.210 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:19.098 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-11T14:28:23.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:25.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:26.266 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:28.158 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-11T14:28:32.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:34.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:35.322 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:37.242 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-11T14:28:41.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:43.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:44.378 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:46.298 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-11T14:28:50.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:52.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:28:53.434 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-09-11T14:28:55.354 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-09-11T14:28:59.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:29:01.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:29:59.498 WARNING:teuthology.provision.fog.smithi105:timed out 2023-09-11T14:30:01.362 WARNING:teuthology.provision.fog.smithi098:timed out 2023-09-11T14:30:05.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:30:05.727 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T14:30:05.728 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T14:30:06.059 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-09-11T14:30:06.060 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-09-11T14:30:06.074 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-09-11T14:30:06.075 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-09-11T14:30:06.130 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-09-11T14:30:06.130 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-09-11T14:30:06.252 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-09-11T14:30:06.281 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-09-11T14:30:06.348 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-09-11T14:30:06.416 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-09-11T14:30:06.483 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-09-11T14:30:06.538 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-09-11T14:30:06.538 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2023-09-11T14:30:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-09-11T14:30:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-09-11T14:30:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2023-09-11T14:30:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2023-09-11T14:30:06.539 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T14:30:06.540 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-09-11T14:30:06.540 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2023-09-11T14:30:06.540 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T14:30:06.540 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-09-11T14:30:06.540 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T14:30:06.541 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T14:30:06.541 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T14:30:06.542 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-09-11T14:30:06.553 DEBUG:teuthology.parallel:result is None 2023-09-11T14:30:07.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:30:07.662 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T14:30:07.663 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T14:30:08.007 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-09-11T14:30:08.008 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-09-11T14:30:08.023 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-09-11T14:30:08.023 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-09-11T14:30:08.078 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-09-11T14:30:08.079 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-09-11T14:30:08.216 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-09-11T14:30:08.244 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-09-11T14:30:08.312 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-09-11T14:30:08.378 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-09-11T14:30:08.445 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-09-11T14:30:08.499 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-09-11T14:30:08.499 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-09-11T14:30:08.499 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-09-11T14:30:08.500 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-09-11T14:30:08.500 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-09-11T14:30:08.500 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-09-11T14:30:08.500 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T14:30:08.501 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-09-11T14:30:08.501 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-09-11T14:30:08.501 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T14:30:08.501 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-09-11T14:30:08.501 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T14:30:08.502 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T14:30:08.502 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T14:30:08.502 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-09-11T14:30:08.503 DEBUG:teuthology.parallel:result is None 2023-09-11T14:30:08.670 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-09-11T14:30:08.671 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T14:30:08.694 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-09-11T14:30:08.694 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T14:30:08.720 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-09-11T14:30:08.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-09-11T14:30:08.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:30:08.803 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-09-11T14:30:08.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-09-11T14:30:08.868 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-09-11T14:30:08.921 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-09-11T14:30:08.922 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-09-11T14:30:08.975 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-09-11T14:30:08.976 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2023-09-11T14:30:08.976 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-09-11T14:30:08.976 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-09-11T14:30:08.976 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2023-09-11T14:30:08.976 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2023-09-11T14:30:08.977 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T14:30:08.977 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-09-11T14:30:08.977 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2023-09-11T14:30:08.977 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T14:30:08.977 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-09-11T14:30:08.978 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T14:30:08.978 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T14:30:08.978 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T14:30:08.979 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-09-11T14:30:09.002 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-09-11T14:30:09.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-09-11T14:30:09.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:30:09.085 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-09-11T14:30:09.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-09-11T14:30:09.154 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-09-11T14:30:09.207 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-09-11T14:30:09.208 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-09-11T14:30:09.261 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-09-11T14:30:09.262 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2023-09-11T14:30:09.262 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-09-11T14:30:09.262 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-09-11T14:30:09.262 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2023-09-11T14:30:09.263 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2023-09-11T14:30:09.263 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T14:30:09.263 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-09-11T14:30:09.263 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2023-09-11T14:30:09.263 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T14:30:09.264 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-09-11T14:30:09.264 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T14:30:09.264 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T14:30:09.264 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T14:30:09.265 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-09-11T14:30:09.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:30:09.371 INFO:teuthology.dispatcher.supervisor:Running job 7393616 2023-09-11T14:30:09.372 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2023-09-11_14:15:17-rados-main-distro-default-smithi/7393616 --name ksirivad-2023-09-11_14:15:17-rados-main-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/ksirivad-2023-09-11_14:15:17-rados-main-distro-default-smithi/7393616/orig.config.yaml 2023-09-11T14:30:09.375 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2023-09-11_14:15:17-rados-main-distro-default-smithi/7393616 2023-09-11T14:30:09.376 INFO:teuthology.dispatcher.supervisor:Job PID: 3876145 2023-09-11T14:30:09.376 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-11T14:32:09.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:34:09.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:36:09.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:38:09.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:40:10.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:42:10.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:44:10.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:46:10.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:48:10.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:50:10.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:52:11.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:54:11.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:56:11.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:58:11.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:00:11.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:02:11.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:04:12.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:06:12.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:08:12.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:10:12.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:12:12.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:14:12.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:16:12.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:18:13.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:20:13.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:22:13.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:24:13.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:26:13.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:28:13.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:30:14.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:32:14.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:34:14.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:36:14.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:38:14.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:40:14.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:42:15.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:44:15.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:46:15.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:48:15.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:50:15.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:52:15.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:54:16.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:56:16.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T15:58:16.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:00:16.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:02:16.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:04:17.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:06:17.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:08:17.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:10:17.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:12:17.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:14:17.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:16:17.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:18:18.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:20:18.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T16:20:18.353 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-11T16:20:18.514 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-11T16:20:18.514 INFO:teuthology.nuke:Checking targets against current locks 2023-09-11T16:20:18.554 DEBUG:teuthology.nuke:shortname: smithi098 2023-09-11T16:20:18.557 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T16:20:18.582 DEBUG:teuthology.nuke:shortname: smithi105 2023-09-11T16:20:18.583 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-11T16:20:18.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-11_14:15:17-rados-main-distro-default-smithi/7393616', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 14:25:02.901326', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD4RDD+BFi3zaWff3hnR1ceSjNaCBRCnwWGFT6y/ctM3Cm9EU3K6d/2eoww/PzRar7tQEYNVq2ma2VCY9bUGPT4='} 2023-09-11T16:20:18.607 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2023-09-11_14:15:17-rados-main-distro-default-smithi/7393616', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 14:25:02.903063', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM2Mm5MKuCZfCytnvTGOjmEDw9xCFiQ+H+mxMMt1ZvNHj3YxJgDykA5IxsP4YNBA1dhuYSD7RAu/Pb8UZNm92QI='} 2023-09-11T16:20:18.634 INFO:teuthology.orchestra.console.smithi098:Power off 2023-09-11T16:20:18.635 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T16:20:18.656 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2023-09-11T16:20:18.657 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T16:20:18.669 INFO:teuthology.orchestra.console.smithi105:Power off 2023-09-11T16:20:18.670 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T16:20:18.678 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2023-09-11T16:20:18.689 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-09-11T16:20:18.690 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T16:20:18.711 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-09-11T16:20:18.778 INFO:teuthology.orchestra.console.smithi098:Power off completed 2023-09-11T16:20:18.812 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-09-11T16:20:18.927 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-09-11T16:20:18.960 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com