2023-10-30T11:44:36.171 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-30T11:44:36.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T11:44:36.305 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faefab35b80>, signals=[15]) 2023-10-30T11:44:36.306 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-10-30T11:44:36.307 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-10-30T11:44:36.307 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-10-30T11:44:36.325 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-10-30T11:44:36.325 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-10-30T11:44:36.325 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-30T11:44:36.327 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /host {"name": "smithi037"} 2023-10-30T11:44:36.349 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-10-30T11:44:36.399 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-30T11:44:36.416 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-30T11:44:36.443 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_9.stream (ID 10) 2023-10-30T11:44:36.444 DEBUG:teuthology.provision.fog.smithi037:FOG request: PUT /host/142 {"imageID": 10} 2023-10-30T11:44:36.458 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10) 2023-10-30T11:44:36.458 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 10} 2023-10-30T11:44:36.494 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 9.stream 2023-10-30T11:44:36.494 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:44:36.512 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream 2023-10-30T11:44:36.513 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:44:36.551 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /tasktype {"name": "deploy"} 2023-10-30T11:44:36.557 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-10-30T11:44:36.588 DEBUG:teuthology.provision.fog.smithi037:FOG request: POST /host/142/task {"taskTypeID": 1} 2023-10-30T11:44:36.593 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-10-30T11:44:36.657 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:44:36.678 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:44:36.742 INFO:teuthology.orchestra.console.smithi037:Power off 2023-10-30T11:44:36.743 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T11:44:36.764 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-10-30T11:44:36.765 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:36.778 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-30T11:44:36.779 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T11:44:36.787 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-30T11:44:36.801 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-30T11:44:36.801 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:36.826 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-30T11:44:40.792 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:40.827 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:40.902 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-30T11:44:40.936 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-30T11:44:44.907 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:44.938 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:45.016 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-30T11:44:45.047 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-30T11:44:45.117 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-10-30T11:44:45.218 INFO:teuthology.orchestra.console.smithi037:Power on 2023-10-30T11:44:45.219 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-30T11:44:45.240 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-10-30T11:44:45.241 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:45.262 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-30T11:44:49.050 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:49.159 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-30T11:44:49.259 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-30T11:44:49.263 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:49.361 INFO:teuthology.orchestra.console.smithi072:Power on 2023-10-30T11:44:49.362 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-30T11:44:49.373 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-30T11:44:49.382 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-10-30T11:44:49.383 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:49.403 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-30T11:44:53.378 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:53.405 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T11:44:53.488 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-10-30T11:44:53.513 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-30T11:44:53.590 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-10-30T11:44:53.614 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-10-30T11:44:53.691 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-10-30T11:44:53.692 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:44:53.715 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-10-30T11:44:53.716 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:45:08.770 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:45:08.777 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:45:23.846 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:45:23.849 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:45:38.926 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:45:38.928 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:45:54.012 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:45:54.016 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:46:09.081 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:46:09.083 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:46:24.162 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:46:24.164 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:46:39.234 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:46:39.236 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:46:54.311 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:46:54.313 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:47:09.374 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None 2023-10-30T11:47:09.376 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:47:09.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:47:24.458 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:47:28.001 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-30T11:47:34.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:47:37.082 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-30T11:47:39.529 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:47:43.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:47:46.138 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-10-30T11:47:52.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:47:54.608 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:48:09.694 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-30T11:48:09.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:48:28.154 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-30T11:48:34.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:48:37.246 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-30T11:48:43.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:48:46.334 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-30T11:48:52.150 WARNING:teuthology.provision.fog.smithi037:timed out 2023-10-30T11:48:52.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:48:55.418 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-30T11:48:58.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:48:58.407 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-30T11:48:58.408 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-30T11:48:58.759 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-10-30T11:48:58.759 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-10-30T11:48:58.775 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-10-30T11:48:58.775 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2023-10-30T11:48:58.831 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-10-30T11:48:58.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-10-30T11:48:58.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2023-10-30T11:48:58.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2023-10-30T11:48:59.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2023-10-30T11:48:59.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-10-30T11:48:59.175 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-10-30T11:48:59.230 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-10-30T11:48:59.231 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2023-10-30T11:48:59.231 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-10-30T11:48:59.231 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-10-30T11:48:59.231 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2023-10-30T11:48:59.232 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2023-10-30T11:48:59.232 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T11:48:59.232 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-10-30T11:48:59.232 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2023-10-30T11:48:59.232 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T11:48:59.233 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-10-30T11:48:59.233 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T11:48:59.233 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T11:48:59.233 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T11:48:59.234 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-10-30T11:48:59.236 DEBUG:teuthology.parallel:result is None 2023-10-30T11:49:01.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:50:01.484 WARNING:teuthology.provision.fog.smithi072:timed out 2023-10-30T11:50:07.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:50:07.767 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-30T11:50:07.768 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-30T11:50:08.221 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-10-30T11:50:08.221 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-10-30T11:50:08.236 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-10-30T11:50:08.237 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-10-30T11:50:08.292 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-10-30T11:50:08.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-10-30T11:50:08.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-10-30T11:50:08.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-10-30T11:50:08.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-10-30T11:50:08.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-10-30T11:50:08.647 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-30T11:50:08.702 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-10-30T11:50:08.702 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-10-30T11:50:08.703 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-10-30T11:50:08.703 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-10-30T11:50:08.703 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-10-30T11:50:08.703 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-10-30T11:50:08.704 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T11:50:08.704 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-30T11:50:08.704 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-10-30T11:50:08.704 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T11:50:08.704 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-10-30T11:50:08.705 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T11:50:08.705 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T11:50:08.705 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T11:50:08.705 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-10-30T11:50:08.706 DEBUG:teuthology.parallel:result is None 2023-10-30T11:50:08.878 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-10-30T11:50:08.879 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-30T11:50:08.900 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-10-30T11:50:08.900 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-30T11:50:08.917 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-10-30T11:50:08.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-30T11:50:08.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:50:09.016 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-10-30T11:50:09.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-10-30T11:50:09.201 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-10-30T11:50:09.255 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-10-30T11:50:09.256 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-10-30T11:50:09.310 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-10-30T11:50:09.311 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2023-10-30T11:50:09.311 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-10-30T11:50:09.311 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-10-30T11:50:09.311 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2023-10-30T11:50:09.311 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2023-10-30T11:50:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T11:50:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-10-30T11:50:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2023-10-30T11:50:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T11:50:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-10-30T11:50:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T11:50:09.313 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T11:50:09.313 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T11:50:09.314 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-10-30T11:50:09.342 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-10-30T11:50:09.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-30T11:50:09.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T11:50:09.427 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-30T11:50:09.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-30T11:50:09.493 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-30T11:50:09.547 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-30T11:50:09.547 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-30T11:50:09.602 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2023-10-30T11:50:09.602 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2023-10-30T11:50:09.602 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2023-10-30T11:50:09.602 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2023-10-30T11:50:09.603 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2023-10-30T11:50:09.603 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2023-10-30T11:50:09.603 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T11:50:09.603 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-10-30T11:50:09.603 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2023-10-30T11:50:09.604 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T11:50:09.604 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2023-10-30T11:50:09.604 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T11:50:09.604 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T11:50:09.604 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T11:50:09.605 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-30T11:50:09.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T11:50:09.724 INFO:teuthology.dispatcher.supervisor:Running job 7441071 2023-10-30T11:50:09.724 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-10-30_10:36:20-rados:verify-main-distro-default-smithi/7441071 --name amathuri-2023-10-30_10:36:20-rados:verify-main-distro-default-smithi --description rados:verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} -- /home/teuthworker/archive/amathuri-2023-10-30_10:36:20-rados:verify-main-distro-default-smithi/7441071/orig.config.yaml 2023-10-30T11:50:09.729 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-10-30_10:36:20-rados:verify-main-distro-default-smithi/7441071 2023-10-30T11:50:09.729 INFO:teuthology.dispatcher.supervisor:Job PID: 3549176 2023-10-30T11:50:09.730 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-30T11:52:09.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T11:54:09.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T11:56:10.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T11:58:10.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T12:00:10.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T12:02:10.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T12:04:10.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T12:04:10.890 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-30T12:04:11.100 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-30T12:04:11.100 INFO:teuthology.nuke:Checking targets against current locks 2023-10-30T12:04:11.152 DEBUG:teuthology.nuke:shortname: smithi037 2023-10-30T12:04:11.153 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-30T12:04:11.165 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-30T12:04:11.165 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-30T12:04:11.175 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-10-30_10:36:20-rados:verify-main-distro-default-smithi/7441071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 11:44:35.405968', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxoXk5X/8s3rZa7GAaC8IhwnW6ho367Oal98uQc9vwkofgm5urf3jPexRGDsH59eOTmQAUiNmV9z/s//0DTbD8='} 2023-10-30T12:04:11.186 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-10-30_10:36:20-rados:verify-main-distro-default-smithi/7441071', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 11:44:35.407757', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbXEZJglZzrI/90FiZe58qOayV7fsnyxguqY6H47vF6Ac3t/3Es2r8NRkwOuYocftPR37Bh92AoA7k7wnP45W0='} 2023-10-30T12:04:11.226 INFO:teuthology.orchestra.console.smithi037:Power off 2023-10-30T12:04:11.227 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T12:04:11.240 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-30T12:04:11.240 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T12:04:11.248 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-10-30T12:04:11.249 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T12:04:11.262 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-30T12:04:11.262 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T12:04:11.269 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-10-30T12:04:11.282 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-30T12:04:11.370 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-10-30T12:04:11.384 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-30T12:04:11.522 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-10-30T12:04:11.531 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com