2023-10-19T05:06:43.066 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T05:06:43.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:06:43.198 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d1405bb80>, signals=[15]) 2023-10-19T05:06:43.200 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-10-19T05:06:43.200 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T05:06:43.200 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-19T05:06:43.224 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-10-19T05:06:43.225 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-10-19T05:06:43.225 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-10-19T05:06:43.227 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-10-19T05:06:43.249 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-10-19T05:06:43.307 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-19T05:06:43.322 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-19T05:06:43.355 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10) 2023-10-19T05:06:43.355 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 10} 2023-10-19T05:06:43.371 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_centos_9.stream (ID 10) 2023-10-19T05:06:43.371 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 10} 2023-10-19T05:06:43.400 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream 2023-10-19T05:06:43.401 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:06:43.417 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of centos 9.stream 2023-10-19T05:06:43.417 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:06:43.455 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T05:06:43.468 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-10-19T05:06:43.490 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-10-19T05:06:43.518 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-10-19T05:06:43.563 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:06:43.577 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:06:43.657 INFO:teuthology.orchestra.console.smithi184:Power off 2023-10-19T05:06:43.658 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T05:06:43.672 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-19T05:06:43.673 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T05:06:43.682 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-10-19T05:06:43.683 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:43.694 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-19T05:06:43.695 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:43.705 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-19T05:06:43.717 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-19T05:06:47.710 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:47.718 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:47.820 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-19T05:06:47.827 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-19T05:06:51.822 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:51.829 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:51.931 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-19T05:06:51.942 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-19T05:06:55.934 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:55.942 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:56.043 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-10-19T05:06:56.051 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-19T05:06:56.145 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-10-19T05:06:56.153 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-19T05:06:56.246 INFO:teuthology.orchestra.console.smithi184:Power on 2023-10-19T05:06:56.247 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T05:06:56.255 INFO:teuthology.orchestra.console.smithi123:Power on 2023-10-19T05:06:56.255 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-19T05:06:56.269 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-10-19T05:06:56.270 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:56.278 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-10-19T05:06:56.279 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:06:56.290 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-10-19T05:06:56.299 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-19T05:07:00.294 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:07:00.301 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:07:00.403 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-10-19T05:07:00.409 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-19T05:07:00.505 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-10-19T05:07:00.510 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-10-19T05:07:00.607 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-10-19T05:07:00.607 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:07:00.611 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-10-19T05:07:00.611 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:07:15.685 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:07:15.687 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:07:30.758 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:07:30.760 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:07:45.838 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:07:45.840 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:08:00.918 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:08:00.920 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:08:15.994 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:08:15.996 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:08:31.070 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:08:31.072 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:08:46.142 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:08:46.144 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:09:01.218 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:09:01.220 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:09:16.298 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:09:16.300 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:09:31.374 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:09:31.376 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:09:46.454 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-10-19T05:09:46.456 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-19T05:09:46.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:09:46.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:04.922 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-19T05:10:04.923 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-19T05:10:10.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:10.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:13.978 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-19T05:10:13.979 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-19T05:10:19.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:19.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:23.034 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-19T05:10:23.066 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-19T05:10:29.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:29.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:32.122 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-10-19T05:10:32.123 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-19T05:10:38.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:10:38.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:11:38.189 WARNING:teuthology.provision.fog.smithi184:timed out 2023-10-19T05:11:38.191 WARNING:teuthology.provision.fog.smithi123:timed out 2023-10-19T05:11:44.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:11:44.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:11:44.387 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T05:11:44.388 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T05:11:44.452 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-19T05:11:44.452 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-19T05:11:44.712 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-10-19T05:11:44.713 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-10-19T05:11:44.728 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-10-19T05:11:44.729 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-10-19T05:11:44.783 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-10-19T05:11:44.784 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-19T05:11:44.803 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-10-19T05:11:44.804 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-10-19T05:11:44.818 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-10-19T05:11:44.819 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-10-19T05:11:44.873 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-10-19T05:11:44.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-10-19T05:11:44.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-10-19T05:11:44.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-10-19T05:11:44.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-10-19T05:11:44.994 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-10-19T05:11:45.020 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-10-19T05:11:45.061 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-19T05:11:45.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-10-19T05:11:45.127 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-19T05:11:45.155 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-10-19T05:11:45.182 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-10-19T05:11:45.182 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2023-10-19T05:11:45.183 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-10-19T05:11:45.183 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-10-19T05:11:45.183 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2023-10-19T05:11:45.183 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2023-10-19T05:11:45.184 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T05:11:45.184 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-19T05:11:45.184 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2023-10-19T05:11:45.184 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T05:11:45.184 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-10-19T05:11:45.185 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T05:11:45.185 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T05:11:45.185 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T05:11:45.186 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-10-19T05:11:45.187 DEBUG:teuthology.parallel:result is None 2023-10-19T05:11:45.222 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-10-19T05:11:45.276 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-10-19T05:11:45.277 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2023-10-19T05:11:45.277 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-10-19T05:11:45.278 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-10-19T05:11:45.278 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2023-10-19T05:11:45.278 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2023-10-19T05:11:45.279 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T05:11:45.279 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-10-19T05:11:45.279 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2023-10-19T05:11:45.280 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T05:11:45.280 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-10-19T05:11:45.280 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T05:11:45.281 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T05:11:45.281 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T05:11:45.282 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-10-19T05:11:45.283 DEBUG:teuthology.parallel:result is None 2023-10-19T05:11:45.452 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-10-19T05:11:45.453 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T05:11:45.483 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-10-19T05:11:45.484 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-19T05:11:45.509 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-10-19T05:11:45.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-19T05:11:45.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:11:45.595 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-19T05:11:45.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-19T05:11:45.660 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-10-19T05:11:45.715 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-10-19T05:11:45.715 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-19T05:11:45.768 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2023-10-19T05:11:45.769 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2023-10-19T05:11:45.769 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2023-10-19T05:11:45.769 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2023-10-19T05:11:45.769 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2023-10-19T05:11:45.770 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2023-10-19T05:11:45.770 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T05:11:45.770 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-10-19T05:11:45.770 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2023-10-19T05:11:45.771 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T05:11:45.771 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2023-10-19T05:11:45.771 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T05:11:45.771 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T05:11:45.771 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T05:11:45.772 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-19T05:11:45.792 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-10-19T05:11:45.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-19T05:11:45.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T05:11:45.876 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-10-19T05:11:45.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-10-19T05:11:45.945 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-10-19T05:11:45.998 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-10-19T05:11:45.999 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-10-19T05:11:46.053 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-10-19T05:11:46.053 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2023-10-19T05:11:46.054 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-10-19T05:11:46.054 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-10-19T05:11:46.054 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2023-10-19T05:11:46.054 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2023-10-19T05:11:46.055 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-19T05:11:46.055 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-10-19T05:11:46.055 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2023-10-19T05:11:46.055 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-19T05:11:46.055 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-10-19T05:11:46.056 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T05:11:46.056 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-19T05:11:46.056 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-19T05:11:46.056 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-10-19T05:11:46.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:11:46.283 INFO:teuthology.dispatcher.supervisor:Running job 7432179 2023-10-19T05:11:46.284 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_ivancich@teuthology --archive /home/teuthworker/archive/ivancich-2023-10-19_04:33:51-rgw-wip-eric-testing-1-distro-default-smithi/7432179 --name ivancich-2023-10-19_04:33:51-rgw-wip-eric-testing-1-distro-default-smithi --description rgw/upgrade/{1-install/pacific/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/rgws-then-osds cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} -- /home/teuthworker/archive/ivancich-2023-10-19_04:33:51-rgw-wip-eric-testing-1-distro-default-smithi/7432179/orig.config.yaml 2023-10-19T05:11:46.288 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ivancich-2023-10-19_04:33:51-rgw-wip-eric-testing-1-distro-default-smithi/7432179 2023-10-19T05:11:46.288 INFO:teuthology.dispatcher.supervisor:Job PID: 3732206 2023-10-19T05:11:46.289 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-19T05:13:46.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:15:46.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:17:46.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:19:46.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:21:47.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T05:21:47.146 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-19T05:21:47.266 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-19T05:21:47.266 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T05:21:47.321 DEBUG:teuthology.nuke:shortname: smithi123 2023-10-19T05:21:47.322 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T05:21:47.342 DEBUG:teuthology.nuke:shortname: smithi184 2023-10-19T05:21:47.343 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T05:21:47.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2023-10-19_04:33:51-rgw-wip-eric-testing-1-distro-default-smithi/7432179', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 05:06:42.205069', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgj9B3+92iAlHUosZxz2BowxEiNbalC5oKCDFoEGzz6aixKif4C2gFqaI8ErwoYZgFDfUEdwF9OzPCMG7+0Ct0='} 2023-10-19T05:21:47.367 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2023-10-19_04:33:51-rgw-wip-eric-testing-1-distro-default-smithi/7432179', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 05:06:42.201765', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBjJjWkl/np3atlOe31W0+IRLsVTSchpqnH8ip86qR5fmudRfKLif9NESOiTdIy8Jp7IZG03ADpUjN/EUJMzHaA='} 2023-10-19T05:21:47.400 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-19T05:21:47.401 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T05:21:47.427 INFO:teuthology.orchestra.console.smithi184:Power off 2023-10-19T05:21:47.428 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-19T05:21:47.435 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-19T05:21:47.435 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:21:47.450 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-10-19T05:21:47.451 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-19T05:21:47.463 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-19T05:21:47.475 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-10-19T05:21:47.564 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-19T05:21:47.577 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-10-19T05:21:47.721 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-10-19T05:21:47.728 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com