2023-07-06T04:59:54.871 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T04:59:54.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T04:59:54.873 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T04:59:55.021 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd38d87b8b0>, signals=[15]) 2023-07-06T04:59:55.023 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-07-06T04:59:55.023 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T04:59:55.024 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-06T04:59:55.051 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-07-06T04:59:55.052 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T04:59:55.052 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-07-06T04:59:55.053 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-07-06T04:59:55.076 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-07-06T04:59:55.129 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T04:59:55.143 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-06T04:59:55.179 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T04:59:55.180 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 3} 2023-07-06T04:59:55.183 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_8.stream (ID 3) 2023-07-06T04:59:55.184 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 3} 2023-07-06T04:59:55.228 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 8.stream 2023-07-06T04:59:55.229 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T04:59:55.231 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.stream 2023-07-06T04:59:55.232 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T04:59:55.275 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T04:59:55.278 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T04:59:55.312 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-07-06T04:59:55.315 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-07-06T04:59:55.373 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T04:59:55.379 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T04:59:55.462 INFO:teuthology.orchestra.console:Power off smithi134 2023-07-06T04:59:55.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:59:55.476 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-06T04:59:55.477 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T04:59:55.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:59:55.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:59:59.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T04:59:59.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:03.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:03.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:07.743 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:07.753 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:07.955 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2023-07-06T05:00:07.964 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-06T05:00:08.057 INFO:teuthology.orchestra.console:Power on smithi134 2023-07-06T05:00:08.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T05:00:08.066 INFO:teuthology.orchestra.console:Power on smithi006 2023-07-06T05:00:08.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T05:00:08.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:08.086 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:12.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:12.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:12.311 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2023-07-06T05:00:12.412 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-07-06T05:00:12.412 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:00:16.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T05:00:16.435 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2023-07-06T05:00:16.536 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-07-06T05:00:16.536 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:00:27.477 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:00:31.592 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:00:42.560 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:00:46.653 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:00:57.634 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:01:01.724 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:01:12.705 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:01:16.800 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:01:27.792 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:01:31.873 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:01:42.864 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:01:46.936 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:01:57.952 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:02:02.004 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:02:13.032 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:02:17.068 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:02:28.120 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:02:32.152 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:02:43.204 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:02:47.231 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-06T05:02:47.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:02:50.384 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-06T05:02:56.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:02:58.277 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-06T05:02:58.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:02:59.440 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-06T05:03:01.424 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-06T05:03:05.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:07.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:08.496 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-06T05:03:10.480 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-06T05:03:14.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:16.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:17.552 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-06T05:03:19.536 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-06T05:03:23.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:25.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:26.608 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-06T05:03:28.592 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-06T05:03:32.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:34.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:35.668 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-06T05:03:37.648 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-06T05:03:41.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:43.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:03:46.704 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-06T05:03:52.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:04:24.394 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T05:04:24.395 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T05:04:41.675 WARNING:teuthology.provision.fog.smithi006:timed out 2023-07-06T05:04:47.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:04:47.894 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T05:04:47.894 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T05:04:48.133 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-07-06T05:04:48.134 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-07-06T05:04:48.154 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-07-06T05:04:48.155 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-07-06T05:04:48.214 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-07-06T05:04:48.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-07-06T05:04:48.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-07-06T05:04:48.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-07-06T05:04:48.421 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-07-06T05:04:48.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-07-06T05:04:48.559 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-06T05:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-07-06T05:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-07-06T05:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-07-06T05:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T05:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T05:04:48.620 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T05:04:48.620 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-07-06T05:04:48.621 DEBUG:teuthology.parallel:result is None 2023-07-06T05:04:49.220 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-07-06T05:04:49.220 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-07-06T05:04:49.244 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-07-06T05:04:49.245 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-07-06T05:04:49.306 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-07-06T05:04:49.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-07-06T05:04:49.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2023-07-06T05:04:49.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2023-07-06T05:04:49.524 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2023-07-06T05:04:49.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-07-06T05:04:49.659 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-07-06T05:04:49.716 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-07-06T05:04:49.717 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2023-07-06T05:04:49.717 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-07-06T05:04:49.717 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-07-06T05:04:49.717 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2023-07-06T05:04:49.717 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-07-06T05:04:49.717 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T05:04:49.718 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-07-06T05:04:49.718 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T05:04:49.718 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-07-06T05:04:49.718 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T05:04:49.718 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T05:04:49.718 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T05:04:49.719 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2023-07-06T05:04:49.719 DEBUG:teuthology.parallel:result is None 2023-07-06T05:04:49.899 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-07-06T05:04:49.900 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T05:04:49.927 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2023-07-06T05:04:49.927 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T05:04:49.945 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-07-06T05:04:49.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-06T05:04:49.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:04:50.013 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-06T05:04:50.044 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-06T05:04:50.044 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-07-06T05:04:50.105 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-07-06T05:04:50.106 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-06T05:04:50.165 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2023-07-06T05:04:50.165 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-07-06T05:04:50.166 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T05:04:50.167 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2023-07-06T05:04:50.167 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T05:04:50.167 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T05:04:50.167 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T05:04:50.168 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-06T05:04:50.194 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2023-07-06T05:04:50.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-07-06T05:04:50.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T05:04:50.259 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-07-06T05:04:50.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-07-06T05:04:50.328 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-07-06T05:04:50.385 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-07-06T05:04:50.385 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-07-06T05:04:50.442 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-07-06T05:04:50.442 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-06T05:04:50.443 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-07-06T05:04:50.444 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T05:04:50.444 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T05:04:50.444 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-06T05:04:50.444 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-07-06T05:04:50.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:04:50.478 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:04:50.577 INFO:teuthology.dispatcher.supervisor:Running job 7327678 2023-07-06T05:04:50.578 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-07-05_21:04:14-rgw-pr-52097-distro-default-smithi/7327678 --name cbodley-2023-07-05_21:04:14-rgw-pr-52097-distro-default-smithi --description rgw/verify/{0-install centos_latest clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated sharding$/{single} striping$/{stripe-greater-than-chunk} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-07-05_21:04:14-rgw-pr-52097-distro-default-smithi/7327678/orig.config.yaml 2023-07-06T05:04:50.581 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-07-05_21:04:14-rgw-pr-52097-distro-default-smithi/7327678 2023-07-06T05:04:50.582 INFO:teuthology.dispatcher.supervisor:Job PID: 6155 2023-07-06T05:04:50.582 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T05:06:50.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:06:50.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:08:50.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:08:50.857 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:10:51.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:10:51.150 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:12:51.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:12:51.326 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:14:51.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:14:51.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:16:51.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:16:51.663 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:18:51.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:18:51.846 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:20:52.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:20:52.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:22:52.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:22:52.195 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:24:52.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:24:52.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:26:52.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:26:52.542 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:28:52.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:28:52.717 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:30:52.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:30:52.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:32:53.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:32:53.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:34:53.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:34:53.229 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:36:53.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:36:53.339 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:38:53.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:38:53.513 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:40:53.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:40:53.687 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:42:53.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:42:53.840 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:44:54.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:44:54.007 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:46:54.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:46:54.185 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:48:54.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:48:54.358 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:50:54.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:50:54.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:52:54.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:52:54.621 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:54:54.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:54:54.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:56:54.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:56:54.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T05:58:55.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T05:58:55.095 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T06:00:55.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T06:00:55.222 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T06:02:55.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T06:02:55.399 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T06:04:55.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T06:04:55.556 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T06:06:55.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T06:06:55.656 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T06:06:55.730 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T06:06:55.895 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T06:06:55.895 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T06:06:55.943 DEBUG:teuthology.nuke:shortname: smithi006 2023-07-06T06:06:55.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T06:06:55.959 DEBUG:teuthology.nuke:shortname: smithi134 2023-07-06T06:06:55.960 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T06:06:55.966 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-05_21:04:14-rgw-pr-52097-distro-default-smithi/7327678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 04:59:54.065162', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWgtAKyjxa2h7QYEXPBTfmxXqXaY2ifov1rxX2+Ux/+a7s7l7zIRSiOP6QnTpJFlLMTiIHDaBV5ZWTuuQrPccIO9K4f538EdchGE7BqmRHDyEiGzEpy09kwQgYD8Upmt884kpLbHdEm0crCXdwSCg5y3UJYE+hEqDetW5mFRlh5y5bhQXunNOTmmuWwq04YiHDL3uW/CRydb2km6bbreekJEGUJ4Z7eM1wUbc3GM/J46oCnOAdn5iv+XZKLslCdEhCk2N+NFLBRsAhfHixSnnhmz3pOOj5+XKDFcOawA6mU1WcUjtiBmzgUAS23A+mm+8MfiGPcQzcNR3EApVIAlAidmUAh253LRMwEjh6BQp+3L6wcJM3ObuTKe8DcahL+pF3dNDJNLgCFKjvk8M91Y9xQ1Bxjb6mScMJv8gY5NkUUTLPEU/u+gPiH6OEpsCqdrXsNlxhVIACcfYBht8ekQRawoxWDr8TkMvdbGuVnqohGyQCq4+BVswIIAFSOTiNkAM='} 2023-07-06T06:06:55.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-05_21:04:14-rgw-pr-52097-distro-default-smithi/7327678', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 04:59:54.062961', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPUtHcd9f+syGUWP0XmX2z8CPYK3pAAxEN071YPhK2CeCvPkmNcRexQCNmYj5nLGXQnt/sulGUGlgUL5Td0JXly01kO7eCO5oEO/81diaLwxhDMDH2IYWqY/56DsXAkeqOz6CkTktTHQVFKIWv1mxHAepfqKo2Sh1eo4ardlA1EAwlv6pspNZPh9kERM3GYKSSZJSohNHRB09kvVkg1nhNWpo03ByzcMBev+UDAvfpPQWIAtVJq1bee3587ZlkfxZKkChQ1VTcTvzL6Xmpupva4QIJSW2MDEAkpGBddcQQeOct+H7NoCF0Cg4hny/xRKMNqWrdBBJOqEnaUaV+jtGXfx8sFiKM/FSmH+pEYEPLSX81LFvy21Fe08lLNNTXsthFcosDX5OFRh+bQb8MaCmh8NYPqeUWpprf1wLjOM/paLLrD116EPB8XvRyzoJakT8eGhdowkRdaA/STc4hJv8TVB0qndTXF7tNIXVNx9AJTf+j2m0yj8ZFgqPX23vMyj0='} 2023-07-06T06:06:56.016 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-06T06:06:56.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T06:06:56.033 INFO:teuthology.orchestra.console:Power off smithi134 2023-07-06T06:06:56.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T06:06:56.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T06:06:56.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T06:06:56.172 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2023-07-06T06:06:56.178 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-06T06:06:56.321 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2023-07-06T06:06:56.338 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com