2023-11-04T13:28:39.097 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T13:28:39.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:28:39.234 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1805bff670>, signals=[15]) 2023-11-04T13:28:39.235 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-11-04T13:28:39.236 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T13:28:39.236 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-04T13:28:39.256 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-11-04T13:28:39.256 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T13:28:39.257 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-11-04T13:28:39.258 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-11-04T13:28:39.281 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"} 2023-11-04T13:28:39.349 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-04T13:28:39.359 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-04T13:28:39.405 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2023-11-04T13:28:39.405 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 10} 2023-11-04T13:28:39.417 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10) 2023-11-04T13:28:39.417 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 10} 2023-11-04T13:28:39.452 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2023-11-04T13:28:39.452 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:28:39.469 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream 2023-11-04T13:28:39.470 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:28:39.516 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T13:28:39.531 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T13:28:39.554 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-11-04T13:28:39.572 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1} 2023-11-04T13:28:39.614 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:28:39.633 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:28:39.723 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-04T13:28:39.724 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T13:28:39.738 INFO:teuthology.orchestra.console.smithi173:Power off 2023-11-04T13:28:39.738 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T13:28:39.747 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-11-04T13:28:39.748 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:39.761 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-11-04T13:28:39.761 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:39.769 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-04T13:28:39.782 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-11-04T13:28:43.770 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:43.783 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:43.879 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-04T13:28:43.892 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-11-04T13:28:47.885 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:47.893 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:47.996 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-04T13:28:48.002 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-04T13:28:48.097 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-04T13:28:48.102 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-11-04T13:28:48.199 INFO:teuthology.orchestra.console.smithi064:Power on 2023-11-04T13:28:48.199 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T13:28:48.206 INFO:teuthology.orchestra.console.smithi173:Power on 2023-11-04T13:28:48.207 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T13:28:48.219 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-11-04T13:28:48.220 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:48.227 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2023-11-04T13:28:48.228 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:48.240 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-04T13:28:48.249 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-04T13:28:52.244 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:52.251 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:52.355 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-04T13:28:52.361 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-04T13:28:56.358 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:56.365 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T13:28:56.467 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-04T13:28:56.473 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-11-04T13:28:56.569 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-11-04T13:28:56.575 INFO:teuthology.orchestra.console.smithi173:Power on completed 2023-11-04T13:28:56.670 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-11-04T13:28:56.671 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:28:56.676 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-11-04T13:28:56.676 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:29:11.754 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:29:11.756 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:29:26.832 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:29:26.833 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:29:41.922 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:29:41.923 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:29:57.006 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:29:57.008 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:30:12.086 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:30:12.088 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:30:27.174 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:30:27.176 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:30:42.258 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:30:42.259 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:30:57.330 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:30:57.332 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:31:12.410 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:31:12.412 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:31:27.498 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:31:27.499 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:31:42.574 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-11-04T13:31:42.576 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-04T13:31:42.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:31:42.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:31:45.694 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-04T13:31:45.695 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-04T13:31:51.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:31:51.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:31:54.782 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-04T13:31:54.783 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-04T13:32:00.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:00.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:03.866 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-04T13:32:03.867 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-04T13:32:09.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:09.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:12.926 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-04T13:32:12.927 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-04T13:32:18.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:18.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:22.010 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-04T13:32:22.011 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-04T13:32:28.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:28.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:31.070 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-04T13:32:31.071 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-11-04T13:32:37.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:32:37.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:33:37.134 WARNING:teuthology.provision.fog.smithi064:timed out 2023-11-04T13:33:37.136 WARNING:teuthology.provision.fog.smithi173:timed out 2023-11-04T13:33:43.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:33:43.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:33:43.397 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T13:33:43.398 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T13:33:43.526 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T13:33:43.526 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T13:33:43.758 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-11-04T13:33:43.759 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-11-04T13:33:43.774 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-11-04T13:33:43.774 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-11-04T13:33:43.832 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-11-04T13:33:43.833 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-11-04T13:33:43.839 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-11-04T13:33:43.840 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-11-04T13:33:43.854 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2023-11-04T13:33:43.854 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2023-11-04T13:33:43.909 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-11-04T13:33:43.909 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-11-04T13:33:43.947 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-11-04T13:33:43.980 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-11-04T13:33:44.025 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2023-11-04T13:33:44.052 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-11-04T13:33:44.053 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-11-04T13:33:44.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2023-11-04T13:33:44.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-11-04T13:33:44.187 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-11-04T13:33:44.193 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-04T13:33:44.248 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-11-04T13:33:44.248 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-11-04T13:33:44.249 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-11-04T13:33:44.249 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-11-04T13:33:44.249 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-11-04T13:33:44.249 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-11-04T13:33:44.250 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T13:33:44.250 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-11-04T13:33:44.250 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-11-04T13:33:44.250 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T13:33:44.251 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-11-04T13:33:44.251 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T13:33:44.251 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T13:33:44.251 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T13:33:44.252 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-11-04T13:33:44.253 DEBUG:teuthology.parallel:result is None 2023-11-04T13:33:44.254 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-11-04T13:33:44.309 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-11-04T13:33:44.310 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-11-04T13:33:44.310 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-11-04T13:33:44.310 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-11-04T13:33:44.310 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-11-04T13:33:44.311 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-11-04T13:33:44.311 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T13:33:44.311 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-11-04T13:33:44.311 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-11-04T13:33:44.311 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T13:33:44.312 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-11-04T13:33:44.312 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T13:33:44.312 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T13:33:44.312 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T13:33:44.313 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2023-11-04T13:33:44.313 DEBUG:teuthology.parallel:result is None 2023-11-04T13:33:44.475 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-11-04T13:33:44.476 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T13:33:44.504 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2023-11-04T13:33:44.504 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T13:33:44.530 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-11-04T13:33:44.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-04T13:33:44.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:33:44.625 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-11-04T13:33:44.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-04T13:33:44.693 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-11-04T13:33:44.747 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-11-04T13:33:44.748 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-04T13:33:44.803 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-11-04T13:33:44.803 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-11-04T13:33:44.803 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-11-04T13:33:44.803 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-11-04T13:33:44.803 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-11-04T13:33:44.804 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-11-04T13:33:44.804 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T13:33:44.804 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-11-04T13:33:44.804 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-11-04T13:33:44.804 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T13:33:44.805 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-11-04T13:33:44.805 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T13:33:44.805 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T13:33:44.805 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T13:33:44.806 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-04T13:33:44.829 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2023-11-04T13:33:44.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-11-04T13:33:44.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T13:33:44.911 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-11-04T13:33:44.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-11-04T13:33:44.977 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-11-04T13:33:45.032 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-11-04T13:33:45.032 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-11-04T13:33:45.085 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-11-04T13:33:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2023-11-04T13:33:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-11-04T13:33:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-11-04T13:33:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2023-11-04T13:33:45.086 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2023-11-04T13:33:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T13:33:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-11-04T13:33:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2023-11-04T13:33:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T13:33:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-11-04T13:33:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T13:33:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T13:33:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T13:33:45.088 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-11-04T13:33:45.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:33:45.199 INFO:teuthology.dispatcher.supervisor:Running job 7446469 2023-11-04T13:33:45.199 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-04_03:30:59-rados-main-distro-default-smithi/7446469 --name yuriw-2023-11-04_03:30:59-rados-main-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-11-04_03:30:59-rados-main-distro-default-smithi/7446469/orig.config.yaml 2023-11-04T13:33:45.203 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-04_03:30:59-rados-main-distro-default-smithi/7446469 2023-11-04T13:33:45.204 INFO:teuthology.dispatcher.supervisor:Job PID: 3264463 2023-11-04T13:33:45.204 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-04T13:35:45.302 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:37:45.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:39:45.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:41:45.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:43:45.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:45:46.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:47:46.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:49:46.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:51:46.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:53:46.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:55:46.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:57:47.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T13:59:47.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T14:01:47.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T14:03:47.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T14:05:47.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T14:07:48.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T14:07:48.079 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-04T14:07:48.234 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-04T14:07:48.234 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T14:07:48.289 DEBUG:teuthology.nuke:shortname: smithi064 2023-11-04T14:07:48.290 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T14:07:48.313 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_03:30:59-rados-main-distro-default-smithi/7446469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 13:28:38.297099', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6S7xrIUxLhBl4fnr0v1nFjnQX9xLi2QfMExBFVC/SbmmbZR831yPU4MbnTZCcARmN47uUJM5qtJQnI8biblbo='} 2023-11-04T14:07:48.316 DEBUG:teuthology.nuke:shortname: smithi173 2023-11-04T14:07:48.317 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T14:07:48.340 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_03:30:59-rados-main-distro-default-smithi/7446469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 13:28:38.295400', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLB3j53/9lX1mfVlia0Vv8Q672EFmGnJ1kQTDoyP/fB1og5W5m7jbbu61EPvfho5jgD8l4adhN2St9y77m2OSS4='} 2023-11-04T14:07:48.365 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-04T14:07:48.366 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T14:07:48.386 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-11-04T14:07:48.387 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T14:07:48.405 INFO:teuthology.orchestra.console.smithi173:Power off 2023-11-04T14:07:48.406 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T14:07:48.415 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-04T14:07:48.428 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-11-04T14:07:48.428 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T14:07:48.450 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-11-04T14:07:48.517 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-04T14:07:48.552 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-11-04T14:07:48.667 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-11-04T14:07:48.701 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com