2023-07-08T00:22:21.211 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-08T00:22:21.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:22:21.213 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:22:21.357 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f02d14418b0>, signals=[15]) 2023-07-08T00:22:21.358 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-07-08T00:22:21.359 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T00:22:21.359 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-08T00:22:21.379 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-07-08T00:22:21.380 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-07-08T00:22:21.380 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-08T00:22:21.381 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-07-08T00:22:21.404 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-07-08T00:22:21.454 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T00:22:21.466 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-08T00:22:21.497 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T00:22:21.497 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 3} 2023-07-08T00:22:21.511 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3) 2023-07-08T00:22:21.511 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 3} 2023-07-08T00:22:21.542 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream 2023-07-08T00:22:21.542 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:22:21.553 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream 2023-07-08T00:22:21.553 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:22:21.657 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T00:22:21.661 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-07-08T00:22:21.695 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-07-08T00:22:21.701 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-07-08T00:22:21.740 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:22:21.756 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:22:21.904 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-08T00:22:21.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:22:21.919 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-08T00:22:21.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T00:22:21.929 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:21.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:25.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:25.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:30.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:30.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:30.279 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-08T00:22:30.290 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-08T00:22:30.381 INFO:teuthology.orchestra.console:Power on smithi038 2023-07-08T00:22:30.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T00:22:30.393 INFO:teuthology.orchestra.console:Power on smithi003 2023-07-08T00:22:30.394 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-08T00:22:30.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:30.419 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:34.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:34.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:38.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:38.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T00:22:38.759 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2023-07-08T00:22:38.772 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2023-07-08T00:22:38.861 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-07-08T00:22:38.861 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:22:38.873 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-07-08T00:22:38.874 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:22:54.117 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:22:54.118 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:23:09.380 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:23:09.387 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:23:24.652 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:23:24.671 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:23:39.963 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:23:39.964 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:23:55.360 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:23:55.369 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:24:10.761 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:24:10.762 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:24:26.230 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:24:26.263 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:24:42.050 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:24:42.240 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:24:57.955 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:24:58.272 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:25:15.296 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:25:16.121 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:25:30.772 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:25:32.120 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:25:46.140 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:25:47.578 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:26:01.532 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:26:03.011 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:26:16.912 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:26:18.363 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:26:32.452 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:26:33.752 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:26:47.904 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:26:49.220 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:27:03.300 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:27:04.566 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:27:18.716 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:27:20.067 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:27:34.412 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:27:35.436 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:27:49.900 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:27:50.740 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:28:05.850 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:28:06.166 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:28:21.276 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:28:21.544 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:28:37.046 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:28:37.143 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:28:52.580 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:28:52.618 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:29:08.048 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:29:08.116 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:29:23.468 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:29:23.470 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:29:38.956 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:29:38.958 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:29:54.260 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:29:54.262 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:30:09.644 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:30:09.645 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:30:24.918 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:30:24.920 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:30:40.212 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-08T00:30:40.213 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:30:40.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:30:40.629 ERROR:teuthology.orchestra.connection:Error authenticating with smithi003.front.sepia.ceph.com: Authentication failed. 2023-07-08T00:30:40.631 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:30:40.631 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:30:40.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-08T00:30:41.636 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-08T00:30:55.507 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:31:10.817 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:31:26.080 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:31:41.342 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:31:56.604 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:32:11.853 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:32:27.097 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:32:33.908 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-08T00:32:33.910 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi003 2023-07-08T00:32:42.336 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:32:42.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-08T00:32:42.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:32:43.128 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-08T00:32:43.406 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-08T00:32:43.406 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:32:43.407 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:32:43.427 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-07-08T00:32:43.427 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-07-08T00:32:43.486 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-07-08T00:32:43.487 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-07-08T00:32:43.547 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-07-08T00:32:43.547 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-08T00:32:43.645 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-07-08T00:32:43.676 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-07-08T00:32:43.745 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-07-08T00:32:43.813 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-08T00:32:43.881 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-08T00:32:43.939 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-07-08T00:32:43.940 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2023-07-08T00:32:43.940 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-07-08T00:32:43.940 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:32:43.940 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2023-07-08T00:32:43.940 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:32:43.941 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:32:43.942 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-07-08T00:32:43.943 DEBUG:teuthology.parallel:result is None 2023-07-08T00:32:57.556 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:33:12.780 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:33:27.968 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:33:43.180 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:33:58.348 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:34:13.524 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:34:28.680 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:34:43.835 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:34:58.980 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:35:14.120 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:35:29.252 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:35:44.384 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:35:59.512 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:36:14.639 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:36:29.760 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-08T00:36:29.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:36:32.912 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-08T00:36:38.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:36:41.968 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-08T00:36:47.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:36:51.060 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-08T00:36:57.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:00.144 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-08T00:37:06.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:09.204 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-08T00:37:15.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:37:18.288 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-08T00:37:24.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:24.352 WARNING:teuthology.provision.fog.smithi038:timed out 2023-07-08T00:38:30.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:30.586 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-08T00:38:30.586 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-08T00:38:30.820 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-07-08T00:38:30.821 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-07-08T00:38:30.884 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-07-08T00:38:30.884 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-07-08T00:38:30.944 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-07-08T00:38:30.945 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-08T00:38:31.042 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-07-08T00:38:31.073 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-07-08T00:38:31.143 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-07-08T00:38:31.214 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-08T00:38:31.285 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-08T00:38:31.343 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-08T00:38:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-07-08T00:38:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-08T00:38:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:38:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-07-08T00:38:31.344 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:38:31.345 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:38:31.346 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-07-08T00:38:31.347 DEBUG:teuthology.parallel:result is None 2023-07-08T00:38:31.541 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-07-08T00:38:31.542 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T00:38:31.570 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-07-08T00:38:31.570 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-08T00:38:31.587 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-07-08T00:38:31.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-08T00:38:31.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:31.701 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-08T00:38:31.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-08T00:38:31.837 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-07-08T00:38:31.897 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-07-08T00:38:31.897 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-08T00:38:31.956 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-07-08T00:38:31.957 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2023-07-08T00:38:31.957 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-07-08T00:38:31.957 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:38:31.957 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2023-07-08T00:38:31.957 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:38:31.957 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:38:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-08T00:38:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:38:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:38:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:38:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:38:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:38:31.959 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-08T00:38:31.987 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-07-08T00:38:31.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-08T00:38:31.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-08T00:38:32.060 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-08T00:38:32.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-08T00:38:32.090 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-08T00:38:32.151 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-08T00:38:32.152 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-08T00:38:32.211 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-08T00:38:32.211 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8" 2023-07-08T00:38:32.211 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-08T00:38:32.212 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-08T00:38:32.212 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8" 2023-07-08T00:38:32.212 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-07-08T00:38:32.212 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-08T00:38:32.212 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-08T00:38:32.213 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-08T00:38:32.213 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-08T00:38:32.213 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-08T00:38:32.213 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-08T00:38:32.213 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-08T00:38:32.214 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-08T00:38:32.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:38:32.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:38:32.352 INFO:teuthology.dispatcher.supervisor:Running job 7328546 2023-07-08T00:38:32.353 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328546 --name adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} -- /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328546/orig.config.yaml 2023-07-08T00:38:32.357 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328546 2023-07-08T00:38:32.358 INFO:teuthology.dispatcher.supervisor:Job PID: 6003 2023-07-08T00:38:32.358 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-08T00:40:32.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:40:32.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:42:32.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:42:32.635 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:44:32.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:44:32.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:46:33.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:46:33.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:48:33.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:48:33.275 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:50:33.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:50:33.450 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:52:33.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:52:33.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:54:33.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:54:33.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:56:33.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:56:33.963 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T00:58:34.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T00:58:34.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T01:00:34.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T01:00:34.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T01:02:34.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T01:02:34.487 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T01:04:34.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T01:04:34.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T01:06:34.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T01:06:34.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T01:08:35.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-08T01:08:35.015 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-08T01:08:35.095 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-08T01:08:35.216 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-08T01:08:35.216 INFO:teuthology.nuke:Checking targets against current locks 2023-07-08T01:08:35.274 DEBUG:teuthology.nuke:shortname: smithi003 2023-07-08T01:08:35.274 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T01:08:35.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 00:22:20.458273', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBElj6CTAWK6sdfRXrziF6JES0foUEB5AsCZF5ZSj+qCEqA9ar0WpmQTjgpz8BelmRcF6zPYJblp7wGZ8m3xJpTI='} 2023-07-08T01:08:35.307 DEBUG:teuthology.nuke:shortname: smithi038 2023-07-08T01:08:35.308 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-08T01:08:35.334 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-07-08_00:21:16-orch:cephadm-wip-adk4-testing-2023-07-07-1312-distro-default-smithi/7328546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-08 00:22:20.459526', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRhOPdg0b7LEzKhS7FG8ouQHsFlYn/3R+rgidQrQtNtIzFvfRNLrWgJGsQjOZvC53HCtT22irgQ6ScYzSnDMDMzXKcyMunNIgdp5YlnbAv5RqjQsq2ht41u2CMJq4KOliD4O/KQGavmmNlLGLdoLPBurSI7ExEYvIZ2yA694uohilgxYOaAHPzmgYySgsnvrMtom8Nr28CoJpDhrqDGqqN/3/XND6FVj5l0zpdQBA7zAUftQ4kfsTYcYRFRKoIgoaq2rGj7oz9UjRYT2tJcDAnI6SlQHbrvIlQhlqyUb0leD2tNJK8f7wRZlf5XM+7YsveXchp76S3yus4MW2Fq5g35i+Bi3C3TbsOuaxF2T4KOb8WK6UOdyvikukoaWs+rUpAICm+dB46fw36kTUugyhkxI1mcOZIW6sPmta3695Xftk0defq23Tb8yMt9gt2IaJPuv1g4+tHs4y94Ji3T7i17YJOtAPV6r3QjpvjZCeeyIKPZYHdIuTTwnodo0eeWnk='} 2023-07-08T01:08:35.357 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-08T01:08:35.358 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T01:08:35.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T01:08:35.414 INFO:teuthology.orchestra.console:Power off smithi038 2023-07-08T01:08:35.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-08T01:08:35.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-08T01:08:35.527 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-08T01:08:35.563 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-07-08T01:08:35.691 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-07-08T01:08:35.716 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com