2023-08-30T13:35:54.502 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T13:35:54.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:35:54.670 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3795a641f0>, signals=[15]) 2023-08-30T13:35:54.672 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-08-30T13:35:54.672 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T13:35:54.672 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-30T13:35:54.700 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-08-30T13:35:54.701 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T13:35:54.701 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-08-30T13:35:54.703 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-08-30T13:35:54.724 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-08-30T13:35:54.791 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T13:35:54.795 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T13:35:54.836 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T13:35:54.836 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10} 2023-08-30T13:35:54.845 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T13:35:54.845 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 10} 2023-08-30T13:35:54.888 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2023-08-30T13:35:54.888 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:35:54.892 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2023-08-30T13:35:54.893 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:35:54.943 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T13:35:54.948 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T13:35:54.983 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-08-30T13:35:54.987 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-08-30T13:35:55.050 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:35:55.059 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:35:55.141 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-30T13:35:55.143 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T13:35:55.162 INFO:teuthology.orchestra.console.smithi194:Power off 2023-08-30T13:35:55.163 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T13:35:55.174 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-30T13:35:55.175 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:35:55.190 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-08-30T13:35:55.190 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:35:55.201 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-30T13:35:55.217 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-30T13:35:55.303 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-30T13:35:55.319 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-08-30T13:35:55.404 INFO:teuthology.orchestra.console.smithi003:Power on 2023-08-30T13:35:55.404 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T13:35:55.420 INFO:teuthology.orchestra.console.smithi194:Power on 2023-08-30T13:35:55.421 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T13:35:55.432 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-08-30T13:35:55.432 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:35:55.446 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-08-30T13:35:55.447 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:35:55.457 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-30T13:35:55.471 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-30T13:35:59.463 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:35:59.473 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:35:59.572 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-30T13:35:59.583 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-30T13:35:59.674 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-08-30T13:35:59.775 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-08-30T13:35:59.775 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:36:03.586 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:36:03.695 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-08-30T13:36:03.796 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-08-30T13:36:03.897 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-08-30T13:36:03.898 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:36:14.847 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:36:18.974 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:36:29.926 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:36:34.054 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:36:45.004 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:36:49.137 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:37:00.078 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:37:04.214 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:37:15.150 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:37:19.290 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:37:30.226 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:37:34.386 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:37:45.318 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:37:49.478 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:38:00.434 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:38:04.586 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:38:15.566 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:38:19.694 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:38:30.670 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-30T13:38:30.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:38:33.850 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T13:38:34.808 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:38:39.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:38:42.906 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T13:38:48.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:38:49.910 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-08-30T13:38:50.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:38:51.994 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T13:38:53.086 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-30T13:38:57.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:38:59.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:01.054 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T13:39:02.170 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-30T13:39:07.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:08.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:10.138 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T13:39:11.226 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-30T13:39:16.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:17.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:19.198 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-30T13:39:20.282 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-30T13:39:25.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:26.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:29.338 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-30T13:39:35.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:39:38.398 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-08-30T13:39:44.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:40:25.246 WARNING:teuthology.provision.fog.smithi003:timed out 2023-08-30T13:40:31.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:40:31.442 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T13:40:31.444 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T13:40:31.786 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-08-30T13:40:31.786 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-08-30T13:40:31.801 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-08-30T13:40:31.802 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-08-30T13:40:31.857 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-08-30T13:40:31.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-30T13:40:31.978 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-08-30T13:40:32.010 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-08-30T13:40:32.080 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-08-30T13:40:32.151 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-30T13:40:32.222 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-30T13:40:32.277 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-30T13:40:32.277 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-08-30T13:40:32.277 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-30T13:40:32.277 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:40:32.278 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-08-30T13:40:32.278 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-08-30T13:40:32.278 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T13:40:32.278 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-30T13:40:32.278 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-08-30T13:40:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T13:40:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:40:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:40:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T13:40:32.279 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:40:32.280 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-08-30T13:40:32.281 DEBUG:teuthology.parallel:result is None 2023-08-30T13:40:44.418 WARNING:teuthology.provision.fog.smithi194:timed out 2023-08-30T13:40:50.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:40:50.654 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T13:40:50.655 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T13:40:50.960 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-08-30T13:40:50.961 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-08-30T13:40:50.976 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-08-30T13:40:50.976 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-08-30T13:40:51.031 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-08-30T13:40:51.032 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-08-30T13:40:51.158 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-08-30T13:40:51.187 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-08-30T13:40:51.256 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-08-30T13:40:51.324 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-08-30T13:40:51.392 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-08-30T13:40:51.447 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-08-30T13:40:51.447 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-08-30T13:40:51.448 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-08-30T13:40:51.448 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:40:51.448 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-08-30T13:40:51.448 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-08-30T13:40:51.448 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T13:40:51.449 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-08-30T13:40:51.449 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-08-30T13:40:51.449 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T13:40:51.449 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:40:51.450 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:40:51.450 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T13:40:51.450 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:40:51.451 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-08-30T13:40:51.451 DEBUG:teuthology.parallel:result is None 2023-08-30T13:40:51.610 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-08-30T13:40:51.611 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T13:40:51.639 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-08-30T13:40:51.639 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T13:40:51.665 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-08-30T13:40:51.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-30T13:40:51.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:40:51.765 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-08-30T13:40:51.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-30T13:40:51.949 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-08-30T13:40:52.003 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-08-30T13:40:52.004 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-30T13:40:52.058 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-30T13:40:52.059 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-08-30T13:40:52.059 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-30T13:40:52.059 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:40:52.060 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-08-30T13:40:52.060 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-08-30T13:40:52.060 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T13:40:52.060 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-30T13:40:52.060 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-08-30T13:40:52.061 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T13:40:52.061 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:40:52.061 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:40:52.061 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T13:40:52.062 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:40:52.062 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-30T13:40:52.089 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-08-30T13:40:52.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-08-30T13:40:52.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T13:40:52.173 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-08-30T13:40:52.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-08-30T13:40:52.240 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-08-30T13:40:52.295 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-08-30T13:40:52.296 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-08-30T13:40:52.350 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-08-30T13:40:52.351 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2023-08-30T13:40:52.351 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-08-30T13:40:52.352 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-08-30T13:40:52.352 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2023-08-30T13:40:52.352 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2023-08-30T13:40:52.353 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T13:40:52.353 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-08-30T13:40:52.353 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2023-08-30T13:40:52.354 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T13:40:52.354 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-08-30T13:40:52.354 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T13:40:52.354 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T13:40:52.354 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T13:40:52.355 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-08-30T13:40:52.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:40:52.460 INFO:teuthology.dispatcher.supervisor:Running job 7384239 2023-08-30T13:40:52.461 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-30_13:15:51-crimson-rados-main-distro-crimson-smithi/7384239 --name matan-2023-08-30_13:15:51-crimson-rados-main-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/archive/matan-2023-08-30_13:15:51-crimson-rados-main-distro-crimson-smithi/7384239/orig.config.yaml 2023-08-30T13:40:52.464 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-30_13:15:51-crimson-rados-main-distro-crimson-smithi/7384239 2023-08-30T13:40:52.465 INFO:teuthology.dispatcher.supervisor:Job PID: 1047242 2023-08-30T13:40:52.465 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T13:42:52.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T13:42:52.635 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T13:42:52.739 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T13:42:52.739 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T13:42:52.785 DEBUG:teuthology.nuke:shortname: smithi003 2023-08-30T13:42:52.786 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T13:42:52.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-30_13:15:51-crimson-rados-main-distro-crimson-smithi/7384239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 13:35:53.602527', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDpKlj4SWfPAHhFtWteBl9ylFsB/0fxTK5hl9soCo7vCD3AJ2w2Wv/S1bR3jrIP7LBCRba11CvZui+15IVnTjEY='} 2023-08-30T13:42:52.809 DEBUG:teuthology.nuke:shortname: smithi194 2023-08-30T13:42:52.809 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T13:42:52.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-30_13:15:51-crimson-rados-main-distro-crimson-smithi/7384239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 13:35:53.600981', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMVoSOF244diNo8Fga3NnYJdQtnCs9+zijug6f6cg+k4PwEu1XupvXZaOOgth+3iXXmWvNzQa0kdoOLhfD/WWFo='} 2023-08-30T13:42:52.858 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-30T13:42:52.859 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T13:42:52.881 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-30T13:42:52.882 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:42:52.894 INFO:teuthology.orchestra.console.smithi194:Power off 2023-08-30T13:42:52.895 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T13:42:52.902 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-30T13:42:52.915 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-08-30T13:42:52.915 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T13:42:52.935 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-08-30T13:42:53.003 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-30T13:42:53.037 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-08-30T13:42:53.159 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-08-30T13:42:53.184 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com