2023-07-08T06:31:50.771 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T06:31:50.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:31:50.773 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:31:50.934 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f931b9988b0>, signals=[15]) 2023-07-08T06:31:50.935 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-07-08T06:31:50.936 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T06:31:50.936 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-08T06:31:50.957 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-07-08T06:31:50.957 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T06:31:50.958 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-07-08T06:31:50.959 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-07-08T06:31:50.982 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-07-08T06:31:51.015 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T06:31:51.045 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T06:31:51.063 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T06:31:51.064 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3} 2023-07-08T06:31:51.083 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T06:31:51.083 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 3} 2023-07-08T06:31:51.100 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream 2023-07-08T06:31:51.100 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:31:51.126 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 8.stream 2023-07-08T06:31:51.127 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:31:51.211 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T06:31:51.235 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T06:31:51.249 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-07-08T06:31:51.270 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-07-08T06:31:51.298 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:31:51.319 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:31:51.462 INFO:teuthology.orchestra.console:Power off smithi098 2023-07-08T06:31:51.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T06:31:51.479 INFO:teuthology.orchestra.console:Power off smithi167 2023-07-08T06:31:51.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T06:31:51.489 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:51.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:51.613 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-07-08T06:31:51.622 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-07-08T06:31:51.714 INFO:teuthology.orchestra.console:Power on smithi098 2023-07-08T06:31:51.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T06:31:51.724 INFO:teuthology.orchestra.console:Power on smithi167 2023-07-08T06:31:51.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T06:31:51.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:51.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:55.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:55.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:31:55.978 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2023-07-08T06:31:56.079 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-07-08T06:31:56.079 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:31:59.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T06:32:00.194 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2023-07-08T06:32:00.295 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-07-08T06:32:00.295 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:32:11.247 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:32:15.536 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:32:26.473 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:32:30.792 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:32:41.712 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:32:46.056 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:32:56.940 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:33:01.292 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:33:12.152 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:33:16.535 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:33:27.406 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:33:31.804 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:33:42.699 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:33:47.140 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:33:59.089 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:34:02.695 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:34:16.234 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:34:19.639 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:34:33.111 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:34:37.082 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:34:50.991 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:34:54.070 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:35:08.448 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:35:09.927 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:35:25.809 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:35:26.867 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:35:43.349 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:35:43.684 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:36:00.888 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:36:01.242 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:36:17.804 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:36:17.820 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-07-08T06:36:19.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:22.896 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-08T06:36:28.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:31.952 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-08T06:36:34.798 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:36:37.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:41.008 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-08T06:36:47.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:50.064 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-08T06:36:50.703 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:36:56.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:36:59.120 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-08T06:37:05.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:37:06.660 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:37:08.176 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-07-08T06:37:14.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:37:22.671 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:37:38.138 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:37:53.524 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:38:08.864 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:38:14.189 WARNING:teuthology.provision.fog.smithi098:timed out 2023-07-08T06:38:20.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:38:20.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:38:20.428 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:38:20.658 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-07-08T06:38:20.658 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-07-08T06:38:20.716 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-07-08T06:38:20.717 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-07-08T06:38:20.775 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-07-08T06:38:20.776 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-07-08T06:38:20.870 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-07-08T06:38:20.899 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-07-08T06:38:20.968 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-07-08T06:38:21.035 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-07-08T06:38:21.101 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-07-08T06:38:21.158 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-07-08T06:38:21.158 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-07-08T06:38:21.158 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-07-08T06:38:21.159 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:38:21.159 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-07-08T06:38:21.159 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:38:21.159 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:38:21.159 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-07-08T06:38:21.159 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:38:21.160 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:38:21.160 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:38:21.160 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:38:21.160 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:38:21.161 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-07-08T06:38:21.161 DEBUG:teuthology.parallel:result is None 2023-07-08T06:38:24.253 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:38:40.067 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:38:55.742 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:39:11.448 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:39:27.128 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:39:42.520 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:39:57.936 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:40:13.308 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:40:28.700 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:40:44.033 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:40:59.372 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:41:14.686 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:41:29.984 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:41:45.284 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:42:00.526 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:42:15.756 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:42:31.008 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:42:46.236 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:43:01.448 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-07-08T06:43:01.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:43:01.722 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed. 2023-07-08T06:43:01.724 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:43:01.724 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:43:01.725 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-08T06:44:53.488 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-08T06:44:53.489 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi167 2023-07-08T06:45:02.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-07-08T06:45:02.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:45:02.792 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-07-08T06:45:03.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-07-08T06:45:03.077 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T06:45:03.077 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T06:45:08.099 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-07-08T06:45:08.100 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-07-08T06:45:08.123 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-07-08T06:45:08.124 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-07-08T06:45:08.184 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-07-08T06:45:08.185 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-07-08T06:45:08.301 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-07-08T06:45:08.332 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-07-08T06:45:08.404 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-07-08T06:45:08.475 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-07-08T06:45:08.545 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-07-08T06:45:08.603 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:45:08.604 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-07-08T06:45:08.605 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:45:08.605 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:45:08.605 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:45:08.605 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:45:08.605 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:45:08.605 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-07-08T06:45:08.606 DEBUG:teuthology.parallel:result is None 2023-07-08T06:45:08.771 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-07-08T06:45:08.771 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T06:45:08.800 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-07-08T06:45:08.801 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T06:45:08.827 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-07-08T06:45:08.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-08T06:45:08.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:45:08.897 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-07-08T06:45:09.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-07-08T06:45:09.041 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-07-08T06:45:09.092 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-07-08T06:45:09.092 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-07-08T06:45:09.151 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2023-07-08T06:45:09.151 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8" 2023-07-08T06:45:09.151 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2023-07-08T06:45:09.152 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:45:09.152 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8" 2023-07-08T06:45:09.152 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:45:09.152 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:45:09.152 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-07-08T06:45:09.153 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:45:09.153 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:45:09.154 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:45:09.154 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:45:09.154 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:45:09.155 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-07-08T06:45:09.183 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-07-08T06:45:09.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-07-08T06:45:09.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T06:45:09.250 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-07-08T06:45:09.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-07-08T06:45:09.320 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-07-08T06:45:09.379 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-07-08T06:45:09.380 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-07-08T06:45:09.443 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2023-07-08T06:45:09.443 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8" 2023-07-08T06:45:09.444 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2023-07-08T06:45:09.444 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2023-07-08T06:45:09.445 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8" 2023-07-08T06:45:09.446 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-07-08T06:45:09.446 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T06:45:09.447 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-07-08T06:45:09.447 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T06:45:09.447 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2023-07-08T06:45:09.448 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T06:45:09.448 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T06:45:09.448 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T06:45:09.449 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-07-08T06:45:09.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:45:09.484 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:45:09.587 INFO:teuthology.dispatcher.supervisor:Running job 7328953 2023-07-08T06:45:09.588 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328953 --name adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi --description orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} -- /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328953/orig.config.yaml 2023-07-08T06:45:09.592 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328953 2023-07-08T06:45:09.593 INFO:teuthology.dispatcher.supervisor:Job PID: 20072 2023-07-08T06:45:09.593 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-08T06:47:09.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:47:09.694 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:49:09.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:49:09.877 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:51:10.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:51:10.072 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:53:10.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:53:10.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:55:10.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:55:10.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:57:10.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:57:10.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T06:59:10.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T06:59:10.849 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:01:11.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:01:11.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:03:11.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T07:03:11.213 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T07:03:11.286 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-08T07:03:11.411 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-08T07:03:11.412 INFO:teuthology.nuke:Checking targets against current locks 2023-07-08T07:03:11.457 DEBUG:teuthology.nuke:shortname: smithi098 2023-07-08T07:03:11.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T07:03:11.485 DEBUG:teuthology.nuke:shortname: smithi167 2023-07-08T07:03:11.485 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T07:03:11.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:49.885762', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDONfNJ2MCKuniSoqwfBmEhJviBy9Tdj3kNLNR7Asmat2LjOgfwvOySdcMHBKziDTifIE2ZEoaArSZeUu4gbUJThVIaskRyhgrg464btW9Dy32spPOEbHfX17Zd1mYycjh9If0QF3hwY0WdiD61fxo+hn1LZTCuiBqoJYdoflDWZgXENJ26SxRRA0nqIf+fIgxz5yczhZPWXqSIIN3UacydYc9PDxgf+zkQKxIdobcDKab4IyUq3kaTkbZJhd9ZWekg/5xRDizBe0XDGI4dklYyHdLTUZwAETHE0gn5J/XprxgF1dbIRQrN97/pgPZtJ2Hl7H4fukFGtwYQYZ9Bz6KzXkxOrAcq/2W+FsO/Pa7je9yGc01yw7QkaYFcW+S4qsyH1N+7rMDuIcA6PKjN0S6Ii4aOaSaXLS2XLnqZCV58LXnAMbcD07zuANvcoBHkkOPhKKfuKATvP3BYka9GE/S8j2VYts4jYNjXwhcgVSYeH88R8z4MG/hM/5zsq72eixs='} 2023-07-08T07:03:11.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_06:30:43-orch:cephadm-wip-adk4-testing-2023-07-07-2139-distro-default-smithi/7328953', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 06:31:49.887021', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCl1dTdQWRnbwZ6prcK8leTH0KXpkw3EOuY4OyX3dXaW8F34UxMjzYGlz4gbLvfjhiXx5+QhWdwoB05dlfb5FZ/P3hJ6pzI7WmDkPftW4bg7+XhM5H1oL6bRV8VF0Hvzx9DyQYPcepQn3Y8ri4MLf2jZpX+hl+9Vaf+ajOV8OWPL2pv3zJkNlG58vUI5c8UDd9Xi4qQAVnbP7ujRklbJ7YfG6jaTpcFue2NEhNc2tVI9GqdLQCmE+M//0zEtoh6dmta/E+ujHEEjG9MBiiVuxx8ff3ZUZ3V0JN9AiRe/fxqdxIy8MPHYstqntnfFGoeiUJt6jp8TMYceXT0gLt6fm/EjDAMusm9xru+VvS7Y0T8HQ5851ZdB99KgmK5tsGDz+tIVipCyzROuaDbPYkl830rrS6+wanic4ylePjyuRDlYnBs1keFJFQuqhFxRsD7o0rnRdeZKxd0QkzCJm1RsUhWQxllKdW2WwYvYfRK1QKwjDD/e7cA0zKs1emuPVrIk8M='} 2023-07-08T07:03:11.537 INFO:teuthology.orchestra.console:Power off smithi098 2023-07-08T07:03:11.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T07:03:11.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T07:03:11.586 INFO:teuthology.orchestra.console:Power off smithi167 2023-07-08T07:03:11.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T07:03:11.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T07:03:11.697 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-07-08T07:03:11.738 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-07-08T07:03:11.860 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-07-08T07:03:11.885 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com