2023-06-21T18:33:10.143 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-21T18:33:10.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:33:10.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:33:10.305 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6969bd68b0>, signals=[15]) 2023-06-21T18:33:10.307 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2023-06-21T18:33:10.307 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T18:33:10.307 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-06-21T18:33:10.334 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-06-21T18:33:10.335 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T18:33:10.336 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-21T18:33:10.337 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /host {"name": "smithi018"} 2023-06-21T18:33:10.359 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /host {"name": "smithi052"} 2023-06-21T18:33:10.415 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-21T18:33:10.426 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-21T18:33:10.456 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_8.stream (ID 3) 2023-06-21T18:33:10.456 DEBUG:teuthology.provision.fog.smithi018:FOG request: PUT /host/124 {"imageID": 3} 2023-06-21T18:33:10.470 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_centos_8.stream (ID 3) 2023-06-21T18:33:10.471 DEBUG:teuthology.provision.fog.smithi052:FOG request: PUT /host/157 {"imageID": 3} 2023-06-21T18:33:10.503 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 8.stream 2023-06-21T18:33:10.503 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:33:10.515 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of centos 8.stream 2023-06-21T18:33:10.515 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:33:10.562 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T18:33:10.566 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T18:33:10.597 DEBUG:teuthology.provision.fog.smithi018:FOG request: POST /host/124/task {"taskTypeID": 1} 2023-06-21T18:33:10.609 DEBUG:teuthology.provision.fog.smithi052:FOG request: POST /host/157/task {"taskTypeID": 1} 2023-06-21T18:33:10.649 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:33:10.659 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:33:10.759 INFO:teuthology.orchestra.console:Power off smithi018 2023-06-21T18:33:10.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T18:33:10.775 INFO:teuthology.orchestra.console:Power off smithi052 2023-06-21T18:33:10.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T18:33:10.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:10.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:14.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:14.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:18.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:18.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:19.140 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2023-06-21T18:33:19.149 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2023-06-21T18:33:19.242 INFO:teuthology.orchestra.console:Power on smithi018 2023-06-21T18:33:19.242 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T18:33:19.250 INFO:teuthology.orchestra.console:Power on smithi052 2023-06-21T18:33:19.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T18:33:19.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:19.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:23.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:23.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:27.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:27.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T18:33:27.616 INFO:teuthology.orchestra.console:Power on for smithi018 completed 2023-06-21T18:33:27.626 INFO:teuthology.orchestra.console:Power on for smithi052 completed 2023-06-21T18:33:27.718 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2023-06-21T18:33:27.718 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:33:27.728 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-06-21T18:33:27.728 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:33:42.817 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:33:42.818 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:33:57.900 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:33:57.902 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:34:12.984 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:34:12.985 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:34:28.080 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:34:28.081 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:34:43.168 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:34:43.169 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:34:58.248 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:34:58.249 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:35:13.328 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:35:13.329 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:35:28.416 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:35:28.417 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:35:43.501 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:35:43.502 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:35:58.600 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-21T18:35:58.602 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-06-21T18:35:58.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:35:58.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:01.744 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-21T18:36:01.745 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-21T18:36:07.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:07.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:10.800 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-21T18:36:10.801 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-21T18:36:16.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:16.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:19.856 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-21T18:36:19.888 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-21T18:36:25.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:25.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:28.912 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-21T18:36:28.944 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-21T18:36:34.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:34.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:37.972 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-21T18:36:38.000 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-21T18:36:43.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:44.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:47.056 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-06-21T18:36:47.057 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-21T18:36:53.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:36:53.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:37:53.122 WARNING:teuthology.provision.fog.smithi018:timed out 2023-06-21T18:37:53.124 WARNING:teuthology.provision.fog.smithi052:timed out 2023-06-21T18:37:59.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:37:59.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:37:59.376 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T18:37:59.377 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T18:37:59.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T18:37:59.391 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T18:37:59.620 INFO:teuthology.provision.fog.smithi018:Node is ready 2023-06-21T18:37:59.621 DEBUG:teuthology.orchestra.run.smithi018:> hostname 2023-06-21T18:37:59.641 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2023-06-21T18:37:59.642 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts 2023-06-21T18:37:59.643 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-06-21T18:37:59.643 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-06-21T18:37:59.662 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-06-21T18:37:59.663 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-06-21T18:37:59.702 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2023-06-21T18:37:59.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-06-21T18:37:59.722 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-06-21T18:37:59.722 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-06-21T18:37:59.818 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts 2023-06-21T18:37:59.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-06-21T18:37:59.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts 2023-06-21T18:37:59.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-06-21T18:37:59.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname 2023-06-21T18:37:59.924 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-06-21T18:37:59.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-06-21T18:37:59.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-06-21T18:38:00.061 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-06-21T18:38:00.062 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-06-21T18:38:00.119 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-06-21T18:38:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8" 2023-06-21T18:38:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-06-21T18:38:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-06-21T18:38:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2023-06-21T18:38:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-06-21T18:38:00.120 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-21T18:38:00.121 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-06-21T18:38:00.121 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-21T18:38:00.121 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-06-21T18:38:00.121 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T18:38:00.121 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T18:38:00.121 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-21T18:38:00.122 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-06-21T18:38:00.123 DEBUG:teuthology.parallel:result is None 2023-06-21T18:38:00.124 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-21T18:38:00.125 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2023-06-21T18:38:00.126 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-21T18:38:00.126 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2023-06-21T18:38:00.126 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T18:38:00.126 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T18:38:00.126 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-21T18:38:00.126 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2023-06-21T18:38:00.127 DEBUG:teuthology.parallel:result is None 2023-06-21T18:38:00.282 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2023-06-21T18:38:00.283 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T18:38:00.384 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-06-21T18:38:00.384 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T18:38:00.404 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2023-06-21T18:38:00.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-06-21T18:38:00.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:38:00.470 DEBUG:teuthology.orchestra.run.smithi018:> true 2023-06-21T18:38:00.540 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2023-06-21T18:38:00.599 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2023-06-21T18:38:00.600 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-06-21T18:38:00.659 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2023-06-21T18:38:00.659 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8" 2023-06-21T18:38:00.659 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-21T18:38:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2023-06-21T18:38:00.661 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T18:38:00.661 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T18:38:00.661 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-21T18:38:00.661 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-06-21T18:38:00.686 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-06-21T18:38:00.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-06-21T18:38:00.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T18:38:00.755 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-06-21T18:38:00.824 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-06-21T18:38:00.885 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-06-21T18:38:00.885 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-06-21T18:38:00.946 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-06-21T18:38:00.946 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8" 2023-06-21T18:38:00.946 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-06-21T18:38:00.947 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-06-21T18:38:00.947 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2023-06-21T18:38:00.947 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-06-21T18:38:00.948 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-21T18:38:00.948 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-06-21T18:38:00.948 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-21T18:38:00.949 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-06-21T18:38:00.949 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T18:38:00.949 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T18:38:00.950 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-21T18:38:00.950 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-21T18:38:00.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:38:00.979 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:38:01.083 INFO:teuthology.dispatcher.supervisor:Running job 7309981 2023-06-21T18:38:01.083 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-21_14:43:14-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi/7309981 --name yuriw-2023-06-21_14:43:14-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi --description rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} -- /home/teuthworker/archive/yuriw-2023-06-21_14:43:14-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi/7309981/orig.config.yaml 2023-06-21T18:38:01.087 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-21_14:43:14-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi/7309981 2023-06-21T18:38:01.088 INFO:teuthology.dispatcher.supervisor:Job PID: 2551 2023-06-21T18:38:01.089 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-21T18:40:01.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:40:01.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:42:01.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:42:01.365 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:44:01.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:44:01.543 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:46:01.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:46:01.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:48:01.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:48:01.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:50:02.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:50:02.074 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:52:02.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:52:02.268 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:54:02.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:54:02.442 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:56:02.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:56:02.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T18:58:02.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T18:58:02.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:00:02.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:00:02.977 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:02:03.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:02:03.155 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:04:03.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:04:03.336 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:06:03.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:06:03.529 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:08:03.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:08:03.713 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:10:03.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:10:03.891 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:12:04.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:12:04.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:14:04.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:14:04.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:16:04.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:16:04.420 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:18:04.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:18:04.608 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:20:04.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:20:04.778 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:22:04.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:22:04.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:24:05.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:24:05.115 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:26:05.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:26:05.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:28:05.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:28:05.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:30:05.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:30:05.639 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:32:05.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T19:32:05.819 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T19:32:05.893 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-21T19:32:06.084 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-21T19:32:06.085 INFO:teuthology.nuke:Checking targets against current locks 2023-06-21T19:32:06.139 DEBUG:teuthology.nuke:shortname: smithi018 2023-06-21T19:32:06.139 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T19:32:06.160 DEBUG:teuthology.nuke:shortname: smithi052 2023-06-21T19:32:06.161 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T19:32:06.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-21_14:43:14-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi/7309981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 18:33:09.289424', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4X6gZ01rhqPoDSOmnycCjGh3w9Ht0PnPZiwXDl/ajNKmRVz+37nP0Ix1zzAdxv+iePAvvOFAkyfRKmRBeKNA00Blctvq3gXPK6lZLt52RSYkSS2uJE7bKURfDa8+0LAOiPQmtavI9TeElvAIE8FcPZDgTXVXqM8ncdQMFQIxxo16r5iP/BOVhJKyFzYCmwwkQTopd3E3Oh/agsnDz9n3bDp+JI9zxhmDSTWebbGSreWXFIb4by/tJPPzGBxwLp75eceexLnirUlY0+bmEs1mschU86yk3O385YBDM7CMdTmJh2zbcHTm/1SLVW34kBVpvqW38ScDqyH2QvfwEAYHL4+ZTvpQSri4o4B8LP1U4i/mZEZp27tMextv3hwAtpa2tbjWV5IVsM20YU4C11mCUUMOUP7Js/vCPJMY4H/9QUaPOQGoPdb3Cs23NI0exQW5f1FFU2uhOk/r7+sSZrXBJ+HB2O9yPUC+gE14TjAQtlqGRbQCO08wcW5cY+LLtYKc='} 2023-06-21T19:32:06.181 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-21_14:43:14-rados-wip-yuri7-testing-2023-06-12-1220-distro-default-smithi/7309981', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 18:33:09.287874', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEQPYrOsdb95X3ilPQIk1h/AhbCLjB2Q9CJvZyGZQBsXvOR0rFS74P4H85ISO0xiXl+VhpRoXZLi4UDNx3muQbrBesscmrOPPxdu5YdxiKwwNUlLQm7hkKwVJ5Ls8IpR9XZW+gNsRBWF4bJNwjMwSWG1NPaWpD1VhQn1rpV4NpYIvDZ9i52oUW2cSc6IOTQXlM9M9OZBdw34h13GBI38O4YmVusS0doX/VxPlyGM7xGwfAabEFfuwVQwGHte6hKamsehLejZ71vZy5+u/dRWVLIKLLxUtmydqRsJbIMEgKK5RdHHI6xf27WxRSF7vIlqDot1GyLPeYdB6o+kn/dSq8v7X5aqpDC8oLQt2wMZF1tYH/lhqL4Kjjne4vrkP1eGYbwgjVYJgl2Hj5GVgxwBLofioNhD5gPfeDydJxA4cJSUawT2YRZXehMPcXHGDdaeER+MwfmcGFwbX7WV9nxtmonIhxFFMOUc/+fnKYOS558snG/IuTuW0GCgj8mA1Zpxs='} 2023-06-21T19:32:06.219 INFO:teuthology.orchestra.console:Power off smithi018 2023-06-21T19:32:06.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T19:32:06.237 INFO:teuthology.orchestra.console:Power off smithi052 2023-06-21T19:32:06.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T19:32:06.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T19:32:06.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T19:32:06.372 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2023-06-21T19:32:06.381 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2023-06-21T19:32:06.525 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2023-06-21T19:32:06.533 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com