2023-11-15T07:29:08.392 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-15T07:29:08.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:29:08.556 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6efd33c670>, signals=[15]) 2023-11-15T07:29:08.557 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-11-15T07:29:08.558 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T07:29:08.558 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-15T07:29:08.586 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-11-15T07:29:08.586 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-11-15T07:29:08.586 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-11-15T07:29:08.588 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-11-15T07:29:08.613 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-11-15T07:29:08.657 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-15T07:29:08.685 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-15T07:29:08.696 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_8.stream (ID 3) 2023-11-15T07:29:08.696 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 3} 2023-11-15T07:29:08.739 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_8.stream (ID 3) 2023-11-15T07:29:08.739 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 3} 2023-11-15T07:29:08.755 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream 2023-11-15T07:29:08.756 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:29:08.790 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 8.stream 2023-11-15T07:29:08.790 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:29:08.824 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T07:29:08.859 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-11-15T07:29:08.863 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-11-15T07:29:08.892 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-11-15T07:29:08.917 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:29:08.951 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:29:09.013 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-15T07:29:09.014 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:29:09.040 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-11-15T07:29:09.041 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:09.059 INFO:teuthology.orchestra.console.smithi194:Power off 2023-11-15T07:29:09.060 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:29:09.075 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-15T07:29:09.087 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-11-15T07:29:09.087 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:09.113 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-15T07:29:09.219 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-11-15T07:29:09.320 INFO:teuthology.orchestra.console.smithi194:Power on 2023-11-15T07:29:09.320 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T07:29:09.343 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-11-15T07:29:09.344 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:09.387 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-15T07:29:13.079 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:13.190 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-15T07:29:13.388 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:13.501 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-11-15T07:29:13.602 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-11-15T07:29:13.703 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-11-15T07:29:13.703 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:29:17.195 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:17.304 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-15T07:29:17.405 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-15T07:29:17.506 INFO:teuthology.orchestra.console.smithi064:Power on 2023-11-15T07:29:17.506 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-15T07:29:17.528 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-11-15T07:29:17.529 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:17.553 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-15T07:29:21.554 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:21.663 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-15T07:29:25.667 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:29:25.896 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-15T07:29:25.997 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-11-15T07:29:26.098 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-11-15T07:29:26.098 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:29:28.793 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:29:41.202 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:29:43.870 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:29:56.326 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:29:58.957 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:30:11.445 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:30:14.041 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:30:26.550 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:30:29.130 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:30:41.650 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:30:44.209 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:30:56.736 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:30:59.291 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:31:11.826 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:31:14.386 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:31:26.934 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:31:29.493 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:31:42.040 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:31:44.594 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:31:57.150 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:31:59.690 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-11-15T07:31:59.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:02.842 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-15T07:32:08.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:11.902 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-15T07:32:12.238 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-11-15T07:32:12.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:15.386 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-15T07:32:17.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:20.986 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-15T07:32:21.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:24.442 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-15T07:32:26.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:30.048 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-15T07:32:30.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:33.499 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-15T07:32:36.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:39.130 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-15T07:32:39.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:42.554 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-15T07:32:45.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:48.190 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-11-15T07:32:48.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:51.610 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-15T07:32:54.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:32:57.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:33:54.255 WARNING:teuthology.provision.fog.smithi194:timed out 2023-11-15T07:33:57.618 WARNING:teuthology.provision.fog.smithi064:timed out 2023-11-15T07:34:00.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:34:00.526 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T07:34:00.527 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T07:34:00.779 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-11-15T07:34:00.779 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-11-15T07:34:00.799 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-11-15T07:34:00.799 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-11-15T07:34:00.860 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-11-15T07:34:00.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-11-15T07:34:00.970 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-11-15T07:34:01.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-11-15T07:34:01.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-11-15T07:34:01.139 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-11-15T07:34:01.208 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-11-15T07:34:01.265 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-11-15T07:34:01.266 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2023-11-15T07:34:01.266 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-11-15T07:34:01.266 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-11-15T07:34:01.266 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2023-11-15T07:34:01.266 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:34:01.267 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T07:34:01.267 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-11-15T07:34:01.267 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T07:34:01.267 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-11-15T07:34:01.268 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:34:01.268 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:34:01.268 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T07:34:01.270 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-11-15T07:34:01.272 DEBUG:teuthology.parallel:result is None 2023-11-15T07:34:03.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:34:03.844 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-15T07:34:03.845 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-15T07:34:04.113 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-11-15T07:34:04.113 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-11-15T07:34:04.133 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-11-15T07:34:04.134 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-11-15T07:34:04.193 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-11-15T07:34:04.194 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-11-15T07:34:04.306 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-11-15T07:34:04.337 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-11-15T07:34:04.406 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-11-15T07:34:04.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-11-15T07:34:04.544 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-15T07:34:04.602 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-11-15T07:34:04.603 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-11-15T07:34:04.603 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-11-15T07:34:04.603 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-11-15T07:34:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-11-15T07:34:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:34:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T07:34:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-11-15T07:34:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T07:34:04.605 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-11-15T07:34:04.605 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:34:04.605 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:34:04.605 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T07:34:04.606 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-11-15T07:34:04.606 DEBUG:teuthology.parallel:result is None 2023-11-15T07:34:04.766 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-11-15T07:34:04.767 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T07:34:04.789 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-11-15T07:34:04.789 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-15T07:34:04.815 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-11-15T07:34:04.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-15T07:34:04.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:34:04.885 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-11-15T07:34:04.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-15T07:34:04.953 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-11-15T07:34:05.010 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-11-15T07:34:05.011 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-15T07:34:05.069 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-11-15T07:34:05.069 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-11-15T07:34:05.069 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-11-15T07:34:05.069 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-11-15T07:34:05.070 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-11-15T07:34:05.070 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:34:05.070 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T07:34:05.070 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-11-15T07:34:05.070 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T07:34:05.071 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-11-15T07:34:05.071 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:34:05.071 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:34:05.071 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T07:34:05.072 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-15T07:34:05.098 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-11-15T07:34:05.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-15T07:34:05.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-15T07:34:05.169 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-11-15T07:34:05.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-11-15T07:34:05.242 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-11-15T07:34:05.308 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-11-15T07:34:05.309 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-11-15T07:34:05.369 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2023-11-15T07:34:05.370 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8" 2023-11-15T07:34:05.370 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2023-11-15T07:34:05.370 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2023-11-15T07:34:05.370 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8" 2023-11-15T07:34:05.371 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-11-15T07:34:05.371 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-15T07:34:05.371 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-11-15T07:34:05.371 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-15T07:34:05.372 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2023-11-15T07:34:05.372 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-15T07:34:05.372 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-15T07:34:05.372 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-15T07:34:05.373 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-11-15T07:34:05.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:34:05.503 INFO:teuthology.dispatcher.supervisor:Running job 7458778 2023-11-15T07:34:05.504 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458778 --name adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458778/orig.config.yaml 2023-11-15T07:34:05.507 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458778 2023-11-15T07:34:05.508 INFO:teuthology.dispatcher.supervisor:Job PID: 2596153 2023-11-15T07:34:05.508 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T07:36:05.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:38:05.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:40:05.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:42:06.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:44:06.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:46:06.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:48:06.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:50:06.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T07:50:06.884 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T07:50:06.985 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T07:50:06.986 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T07:50:07.035 DEBUG:teuthology.nuke:shortname: smithi064 2023-11-15T07:50:07.036 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T07:50:07.058 DEBUG:teuthology.nuke:shortname: smithi194 2023-11-15T07:50:07.058 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T07:50:07.062 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 07:29:07.551471', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEW8EdXN9mOii6QDu38GpwqFrcgms7zsscWHibNx/Y0wfVJ0m41SV7P+uM+u+n7Nv2AMaIhI4WG7D9hTF8fVr98='} 2023-11-15T07:50:07.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-11-15_03:42:13-orch:cephadm-wip-adk-testing-2023-11-14-1702-distro-default-smithi/7458778', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 07:29:07.552696', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEEbd5pVacqOdG0P1jiSuvZ2dX683KTJV7R7nt4+UxAqYKO2urn7ks6kjya2pXTbxfZ2HSM9qCPUFs6XADlS92Y='} 2023-11-15T07:50:07.112 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-15T07:50:07.113 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:50:07.135 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-11-15T07:50:07.136 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:50:07.155 INFO:teuthology.orchestra.console.smithi194:Power off 2023-11-15T07:50:07.156 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T07:50:07.172 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-15T07:50:07.178 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-11-15T07:50:07.178 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T07:50:07.200 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-11-15T07:50:07.273 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-15T07:50:07.302 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-11-15T07:50:07.423 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-11-15T07:50:07.448 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com