2023-07-13T01:21:41.485 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-13T01:21:41.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:21:41.487 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:21:41.647 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6ab4a3ee0>, signals=[15]) 2023-07-13T01:21:41.649 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-07-13T01:21:41.649 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T01:21:41.650 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-07-13T01:21:41.674 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2023-07-13T01:21:41.675 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2023-07-13T01:21:41.675 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-07-13T01:21:41.677 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"} 2023-07-13T01:21:41.699 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /host {"name": "smithi100"} 2023-07-13T01:21:41.759 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T01:21:41.774 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-13T01:21:41.810 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T01:21:41.811 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 3} 2023-07-13T01:21:41.815 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_8.stream (ID 3) 2023-07-13T01:21:41.815 DEBUG:teuthology.provision.fog.smithi100:FOG request: PUT /host/205 {"imageID": 3} 2023-07-13T01:21:41.863 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream 2023-07-13T01:21:41.864 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:21:41.866 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 8.stream 2023-07-13T01:21:41.866 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:21:41.905 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T01:21:41.907 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /tasktype {"name": "deploy"} 2023-07-13T01:21:41.943 DEBUG:teuthology.provision.fog.smithi100:FOG request: POST /host/205/task {"taskTypeID": 1} 2023-07-13T01:21:41.947 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1} 2023-07-13T01:21:41.998 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:21:42.001 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:21:42.096 INFO:teuthology.orchestra.console:Power off smithi100 2023-07-13T01:21:42.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:21:42.114 INFO:teuthology.orchestra.console:Power off smithi029 2023-07-13T01:21:42.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T01:21:42.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:42.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:46.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:46.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:50.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:50.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:50.482 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-07-13T01:21:50.583 INFO:teuthology.orchestra.console:Power on smithi029 2023-07-13T01:21:50.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T01:21:50.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:54.377 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:54.589 INFO:teuthology.orchestra.console:Power off for smithi100 completed 2023-07-13T01:21:54.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:54.691 INFO:teuthology.orchestra.console:Power on smithi100 2023-07-13T01:21:54.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-13T01:21:54.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:58.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:58.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T01:21:58.953 INFO:teuthology.orchestra.console:Power on for smithi100 completed 2023-07-13T01:21:59.059 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2023-07-13T01:21:59.060 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:21:59.076 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2023-07-13T01:21:59.178 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-07-13T01:21:59.178 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:22:14.133 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:22:14.229 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:22:29.200 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:22:29.276 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:22:44.264 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:22:44.324 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:22:59.328 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:22:59.372 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:23:14.396 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:23:14.411 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:23:29.460 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:23:29.462 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:23:44.528 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:23:44.530 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:23:59.592 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:23:59.593 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:24:14.656 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:24:14.657 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:24:29.720 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:24:29.722 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:24:44.792 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None 2023-07-13T01:24:44.793 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:24:44.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:24:47.924 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:24:53.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:24:57.008 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:24:59.860 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-07-13T01:24:59.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:00.891 ERROR:teuthology.orchestra.connection:Error authenticating with smithi029.front.sepia.ceph.com: Authentication failed. 2023-07-13T01:25:00.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:25:00.895 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:25:00.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-13T01:25:03.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:06.064 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:25:12.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:15.120 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:25:21.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:24.176 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:25:30.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:33.233 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:25:39.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:42.288 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:25:48.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:25:51.344 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:25:57.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:26:00.400 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:26:06.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:26:24.880 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:26:30.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:26:33.936 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:26:39.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:26:42.992 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-07-13T01:26:48.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:26:49.184 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:26:49.185 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:27:09.757 INFO:teuthology.provision.fog.smithi100:Node is ready 2023-07-13T01:27:09.757 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2023-07-13T01:27:09.782 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2023-07-13T01:27:09.782 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2023-07-13T01:27:09.842 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2023-07-13T01:27:09.843 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2023-07-13T01:27:09.961 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2023-07-13T01:27:09.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2023-07-13T01:27:10.060 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2023-07-13T01:27:10.128 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2023-07-13T01:27:10.196 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-07-13T01:27:10.255 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2023-07-13T01:27:10.255 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8" 2023-07-13T01:27:10.256 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2023-07-13T01:27:10.256 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:27:10.256 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2023-07-13T01:27:10.256 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:27:10.256 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:27:10.256 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2023-07-13T01:27:10.257 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:27:10.257 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:27:10.257 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:27:10.257 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:27:10.257 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:27:10.258 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2023-07-13T01:27:10.259 DEBUG:teuthology.parallel:result is None 2023-07-13T01:27:13.776 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-13T01:27:13.777 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi029 2023-07-13T01:27:22.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-13T01:27:22.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:27:23.042 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-07-13T01:27:23.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-13T01:27:23.318 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-13T01:27:23.318 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-13T01:27:23.339 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-07-13T01:27:23.340 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-07-13T01:27:23.401 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-07-13T01:27:23.401 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-07-13T01:27:23.462 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-07-13T01:27:23.463 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-07-13T01:27:23.583 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-07-13T01:27:23.616 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-07-13T01:27:23.687 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-07-13T01:27:23.757 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-07-13T01:27:23.826 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-07-13T01:27:23.886 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-07-13T01:27:23.886 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2023-07-13T01:27:23.886 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-07-13T01:27:23.886 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:27:23.887 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:27:23.888 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:27:23.888 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-07-13T01:27:23.888 DEBUG:teuthology.parallel:result is None 2023-07-13T01:27:24.045 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-07-13T01:27:24.046 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T01:27:24.076 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2023-07-13T01:27:24.076 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-13T01:27:24.102 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-07-13T01:27:24.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-13T01:27:24.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:27:24.170 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-07-13T01:27:24.196 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-07-13T01:27:24.197 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-07-13T01:27:24.255 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-07-13T01:27:24.256 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-07-13T01:27:24.314 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2023-07-13T01:27:24.314 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-07-13T01:27:24.315 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:27:24.316 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:27:24.316 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:27:24.316 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:27:24.316 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:27:24.317 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-07-13T01:27:24.342 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2023-07-13T01:27:24.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-07-13T01:27:24.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-13T01:27:24.412 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-07-13T01:27:24.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-07-13T01:27:24.505 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-07-13T01:27:24.566 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-07-13T01:27:24.566 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-07-13T01:27:24.626 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2023-07-13T01:27:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8" 2023-07-13T01:27:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2023-07-13T01:27:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2023-07-13T01:27:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8" 2023-07-13T01:27:24.627 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-13T01:27:24.628 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-13T01:27:24.629 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-07-13T01:27:24.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:27:24.662 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:27:24.801 INFO:teuthology.dispatcher.supervisor:Running job 7335587 2023-07-13T01:27:24.802 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335587 --name gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} -- /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335587/orig.config.yaml 2023-07-13T01:27:24.806 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335587 2023-07-13T01:27:24.807 INFO:teuthology.dispatcher.supervisor:Job PID: 8087 2023-07-13T01:27:24.807 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-13T01:29:24.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:29:24.905 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:31:25.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:31:25.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:33:25.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:33:25.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:35:25.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:35:25.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:37:25.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:37:25.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:39:25.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:39:25.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:41:25.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:41:25.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:43:26.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:43:26.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:45:26.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:45:26.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:47:26.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:47:26.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:49:26.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:49:26.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:51:26.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:51:26.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:53:27.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:53:27.049 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:55:27.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:55:27.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:57:27.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:57:27.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T01:59:27.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T01:59:27.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:01:27.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:01:27.758 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:03:27.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:03:27.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:05:28.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:05:28.102 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:07:28.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:07:28.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:09:28.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:09:28.457 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:11:28.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:11:28.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:13:28.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-13T02:13:28.814 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-13T02:13:28.885 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-13T02:13:28.978 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-13T02:13:28.978 INFO:teuthology.nuke:Checking targets against current locks 2023-07-13T02:13:29.033 DEBUG:teuthology.nuke:shortname: smithi029 2023-07-13T02:13:29.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:13:29.061 DEBUG:teuthology.nuke:shortname: smithi100 2023-07-13T02:13:29.061 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-13T02:13:29.063 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335587', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:21:40.637004', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDrj/BLapAsTUkXqVXxTJ5ixB+WMFw4+J62nQj8iGXUHQQ7qxeJ4031xzkSf1YeQv17mfexPTKqgHgy9gvZvn5t5qKvyIKCMoadlQqNCb0gfdrXT+HIvxtBiGE8jGXqzqXl4mVK+hv0Gc07uNzUAfqf3HKf6pH8wOqFdB5YgkbfJtaitxNYMcGljttK4OcuL2f2nShRRoiTaLZPoBiufL5TgnSDQneIMMStdk/RkZdcP1E5tS83DkAdguaHCvJ2inzsPlS2pPJfFksZNH2zWVVApVgdnGOeXC5IYREP96r+mMvegzaDNclENzOBXvvdFs6DAqhKIohtQtFwebLLJvS6xZdCbkxFv46mIkuRpAfHPIM9iaGXlOagTGEGkshQmk21DhH86MDtl6zzRrLM5mhWPtAQIdP2eaHtdeKv2JnZOKFlLW2b3gcE/Xh1H3iT4xNaCloPNL8glFIh2XTa86SpbOFiB97eggyoyR4i6BOCxkNCu2hJXs+P6w+Ccp43G8='} 2023-07-13T02:13:29.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_00:38:31-orch:cephadm-cv-refactor-osd-objectstore-distro-default-smithi/7335587', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 01:21:40.638565', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9XHEEBpXLnuZfX344VvAl7o/HKJ2FFXsS0J/51+nKVdI1PVdv7xxDbAwgDZP3X7Vr1DwaqscwV54qjfuGOAIM+PcOpGYXMoVqr4yIqIdhNlZ0lmduXaMVYXY5acdmni5V7aakxCgmJPyxVXW4HX4S7aDSgjbMI1JP2ufnl12h7KnRTQt7w6gwfeU4b06EFrDWGyGwtX1surd7Zky2GBF7JBSkAp1Er4LVbBaIhCzRS8lVx6+o5IxL4mi/G0e6ZiFuchxHbujCW7kDKL5GtxdkhtW2pmLv6guCMvmk2qjhiWyrUdRGIjA4Zni9RLb37ZmeGhyI7MFyyd0tCQoWTW4gamiXrtIw87QaaAeml8LzSGmKXcvbHTIrTK2dRKAxeqGjedeI7gNtA5KaiQiyYJzTE/opEXBQGU6Me0f4vsGxNOE1ThUkatCoBr6j/QQLdyfYCYvx2GrdePrCePZAFY+OtG/uC3N2ccUJp4OUtXaEdTmQOXF5iqrxWuVMAvzmV0M='} 2023-07-13T02:13:29.118 INFO:teuthology.orchestra.console:Power off smithi029 2023-07-13T02:13:29.119 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:13:29.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:13:29.165 INFO:teuthology.orchestra.console:Power off smithi100 2023-07-13T02:13:29.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-13T02:13:29.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-13T02:13:29.276 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-07-13T02:13:29.314 INFO:teuthology.orchestra.console:Power off for smithi100 completed 2023-07-13T02:13:29.434 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-07-13T02:13:29.470 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com