2023-07-03T16:04:26.441 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-03T16:04:26.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:04:26.443 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:04:26.625 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8720108b0>, signals=[15]) 2023-07-03T16:04:26.628 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-07-03T16:04:26.629 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T16:04:26.629 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-07-03T16:04:26.657 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-07-03T16:04:26.658 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-07-03T16:04:26.658 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-03T16:04:26.660 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-07-03T16:04:26.690 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-07-03T16:04:26.742 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-03T16:04:26.764 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-03T16:04:26.802 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3) 2023-07-03T16:04:26.802 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 3} 2023-07-03T16:04:26.807 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-07-03T16:04:26.807 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3} 2023-07-03T16:04:26.850 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2023-07-03T16:04:26.850 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:04:26.854 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-07-03T16:04:26.854 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:04:26.932 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T16:04:26.937 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-07-03T16:04:26.975 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-07-03T16:04:26.985 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-07-03T16:04:27.023 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:04:27.040 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:04:27.145 INFO:teuthology.orchestra.console:Power off smithi132 2023-07-03T16:04:27.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T16:04:27.161 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-03T16:04:27.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T16:04:27.173 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:27.185 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:31.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:31.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:35.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:35.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:35.532 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-03T16:04:35.634 INFO:teuthology.orchestra.console:Power on smithi159 2023-07-03T16:04:35.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T16:04:35.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:39.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:39.638 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-07-03T16:04:39.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:39.739 INFO:teuthology.orchestra.console:Power on smithi132 2023-07-03T16:04:39.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-03T16:04:39.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:43.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:43.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T16:04:43.996 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2023-07-03T16:04:44.004 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-07-03T16:04:44.097 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-07-03T16:04:44.098 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:04:44.104 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-07-03T16:04:44.105 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:04:59.216 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:04:59.217 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:05:14.312 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:05:14.314 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:05:29.398 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:05:29.399 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:05:44.486 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:05:44.488 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:05:59.584 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:05:59.586 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:06:14.685 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:06:14.687 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:06:29.790 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:06:29.792 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:06:44.897 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:06:44.898 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:07:00.016 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:07:00.018 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:07:15.136 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:07:15.138 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:07:30.238 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-03T16:07:30.239 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-03T16:07:30.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:30.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:33.392 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:07:33.393 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-03T16:07:39.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:39.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:42.480 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:07:42.481 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-03T16:07:48.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:48.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:51.540 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:07:51.541 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-03T16:07:57.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:07:57.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:00.624 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:08:00.625 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-03T16:08:06.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:06.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:09.684 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:08:09.716 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-03T16:08:15.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:15.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:18.768 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:08:18.769 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-03T16:08:24.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:24.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:08:27.824 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-03T16:08:33.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:09:24.824 WARNING:teuthology.provision.fog.smithi132:timed out 2023-07-03T16:09:30.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:09:31.072 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T16:09:31.073 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T16:09:31.321 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-07-03T16:09:31.322 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-07-03T16:09:31.341 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-07-03T16:09:31.341 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-07-03T16:09:31.401 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-07-03T16:09:31.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-07-03T16:09:31.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-07-03T16:09:31.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-07-03T16:09:31.600 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-07-03T16:09:31.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-07-03T16:09:31.738 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-07-03T16:09:31.795 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T16:09:31.796 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-07-03T16:09:31.797 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T16:09:31.797 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-07-03T16:09:31.797 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T16:09:31.797 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T16:09:31.797 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T16:09:31.798 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-07-03T16:09:31.799 DEBUG:teuthology.parallel:result is None 2023-07-03T16:09:33.832 WARNING:teuthology.provision.fog.smithi159:timed out 2023-07-03T16:09:39.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:09:40.083 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-03T16:09:40.084 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-03T16:09:40.335 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-07-03T16:09:40.335 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-07-03T16:09:40.354 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-07-03T16:09:40.354 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-07-03T16:09:40.413 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-07-03T16:09:40.413 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-03T16:09:40.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-07-03T16:09:40.534 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-07-03T16:09:40.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-07-03T16:09:40.671 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-03T16:09:40.738 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-03T16:09:40.795 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-07-03T16:09:40.796 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-07-03T16:09:40.796 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-07-03T16:09:40.796 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-07-03T16:09:40.797 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-07-03T16:09:40.797 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-07-03T16:09:40.797 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T16:09:40.797 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-07-03T16:09:40.797 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T16:09:40.798 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-07-03T16:09:40.798 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T16:09:40.798 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T16:09:40.798 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T16:09:40.798 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-07-03T16:09:40.799 DEBUG:teuthology.parallel:result is None 2023-07-03T16:09:40.999 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-07-03T16:09:41.000 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T16:09:41.022 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-07-03T16:09:41.022 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-03T16:09:41.048 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-07-03T16:09:41.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-07-03T16:09:41.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:09:41.117 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-07-03T16:09:41.190 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-07-03T16:09:41.191 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-07-03T16:09:41.251 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-07-03T16:09:41.251 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-07-03T16:09:41.312 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-07-03T16:09:41.312 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-07-03T16:09:41.312 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-07-03T16:09:41.312 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-07-03T16:09:41.313 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T16:09:41.314 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T16:09:41.314 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T16:09:41.315 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-07-03T16:09:41.339 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-07-03T16:09:41.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-03T16:09:41.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-03T16:09:41.407 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-07-03T16:09:41.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-03T16:09:41.479 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-07-03T16:09:41.536 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-07-03T16:09:41.537 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-03T16:09:41.594 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-03T16:09:41.595 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-07-03T16:09:41.596 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-03T16:09:41.596 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-07-03T16:09:41.596 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-03T16:09:41.596 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-03T16:09:41.596 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-03T16:09:41.597 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-03T16:09:41.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:09:41.623 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:09:41.716 INFO:teuthology.dispatcher.supervisor:Running job 7324729 2023-07-03T16:09:41.716 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-03_15:23:25-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7324729 --name yuriw-2023-07-03_15:23:25-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi --description rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e} -- /home/teuthworker/archive/yuriw-2023-07-03_15:23:25-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7324729/orig.config.yaml 2023-07-03T16:09:41.719 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-03_15:23:25-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7324729 2023-07-03T16:09:41.720 INFO:teuthology.dispatcher.supervisor:Job PID: 20933 2023-07-03T16:09:41.720 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-03T16:11:41.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:11:41.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:13:41.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:13:41.993 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:15:42.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:15:42.173 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:17:42.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:17:42.342 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:19:42.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:19:42.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:21:42.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:21:42.717 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:23:42.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:23:42.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:25:43.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:25:43.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:27:43.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:27:43.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:29:43.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:29:43.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:31:43.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:31:43.582 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:33:43.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:33:43.762 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:35:43.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:35:43.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:37:44.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:37:44.132 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:39:44.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:39:44.307 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:41:44.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:41:44.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:43:44.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:43:44.662 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:45:44.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:45:44.832 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:47:45.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:47:45.006 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:49:45.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:49:45.192 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:51:45.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:51:45.364 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:53:45.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:53:45.584 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:55:45.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:55:45.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:57:45.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:57:45.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T16:59:46.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T16:59:46.067 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T17:01:46.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T17:01:46.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T17:03:46.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T17:03:46.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T17:05:46.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-03T17:05:46.575 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-03T17:05:46.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-03T17:05:46.801 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-03T17:05:46.801 INFO:teuthology.nuke:Checking targets against current locks 2023-07-03T17:05:46.854 DEBUG:teuthology.nuke:shortname: smithi132 2023-07-03T17:05:46.854 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T17:05:46.874 DEBUG:teuthology.nuke:shortname: smithi159 2023-07-03T17:05:46.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-03T17:05:46.878 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-03_15:23:25-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7324729', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 16:04:25.602835', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9zxBM5/z/8uG3OIpLHkN8jLEzYYWTCx/Wt6+h8hNPW4vAryukX15Tz+k39gBo9Cq26VIDq76DdtL/kuOgjT2NcrzCuj/nTNQToBv95n3nnGs2qrt5dr3DwStXiKCyhkwcDzykESgB78rAkwYmDryxvBdIi8mDB0q9cxvh1phGcJ1QCJ1emNjkiam4lYVgFIxy7C2HX1dirSqiFCBzU72h8qhDHdGq5UXK6JozGMNaAo5CsD8AxWsyOARmWJHqbJcrGVSm+eIsuFFQ1eRLNpX+tWra0c/tSoLN3duYUvQa12tuq4hquTnCQxWPBi7RXqzfh9IJcyJVPmfqoUVTwK4x9S6VxBdJzYsEWZxsS9rda3y6ruft23PnYzz1SA6fyNuw5g9Rp/7qmG8aDAruSnlH6hTtk1ery0p8h4x7Un8JgZjdGbu7wWhXhcpiarYkXdZzXhdW7LcfPon6PdzDqYpkew5fIsFuBZgIfp8MCfdKA5lLtcJAktWKmYbz+nXw2ic='} 2023-07-03T17:05:46.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-03_15:23:25-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7324729', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-03 16:04:25.600879', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy+RRKKA2/YzIut0KMrCfP1GSSmsE4wlhShsh/eJUzPmyaB1MD1GLqvlGod3KrsXKAZv82CVbEm243D84ggZZL0gqG+zj1MlNFSWH0UfBw94mmUQ9mekRrC9qjl2PjZTriwI7m8TtqvjaQXby6jwTeK30h6M3WUVkSiewKdaSzMVtStyWm+Lh34DUksgV+1dvUjoDzOrlwBwbNl/V9JXPOt3otO8rhkxaXImiO5ciX7pgPB6VjVSuvTcJdNC7vzhRaFlo4pxi4Je8IyMkjps3DStiECVPMgiYG6tBmgbbeXkUorKkGz4tHMBimmQtKkm+unKxYymQdT2GfghSUgL20vS5Zt/UXzEeKqBKC/vkJ6QdHZwnRmHnn6rPELYiMutbr3ZM6c1QNcWHZF4zc/BuEn01Zsg+lZ8ybbWmcQR/D9F0iprBGc8COlyykvi7Vg6SfShpZvZpXY7ErWGeurcpw/0uY6elpQcpxa4O/AxnPL8L88DiJmugPDYt4a8VXTj0='} 2023-07-03T17:05:46.929 INFO:teuthology.orchestra.console:Power off smithi132 2023-07-03T17:05:46.930 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T17:05:46.946 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-03T17:05:46.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-03T17:05:46.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T17:05:46.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-03T17:05:47.082 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-07-03T17:05:47.095 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-03T17:05:47.250 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-07-03T17:05:47.258 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com