2023-06-24T17:50:55.105 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-24T17:50:55.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T17:50:55.107 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T17:50:55.235 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5f7b34b3a0>, signals=[15]) 2023-06-24T17:50:55.236 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-06-24T17:50:55.237 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-06-24T17:50:55.237 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-06-24T17:50:55.265 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-06-24T17:50:55.342 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-06-24T17:50:55.384 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_centos_8.stream (ID 3) 2023-06-24T17:50:55.384 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 3} 2023-06-24T17:50:55.432 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of centos 8.stream 2023-06-24T17:50:55.432 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:50:55.485 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-06-24T17:50:55.524 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-06-24T17:50:55.588 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:50:55.676 INFO:teuthology.orchestra.console:Power off smithi184 2023-06-24T17:50:55.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T17:50:55.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:50:59.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:51:03.837 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:51:07.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:51:08.158 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-06-24T17:51:08.259 INFO:teuthology.orchestra.console:Power on smithi184 2023-06-24T17:51:08.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-24T17:51:08.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:51:12.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:51:16.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T17:51:16.626 INFO:teuthology.orchestra.console:Power on for smithi184 completed 2023-06-24T17:51:16.727 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-06-24T17:51:16.728 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:51:31.802 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:51:46.876 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:52:01.944 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:52:17.012 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:52:32.076 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:52:47.156 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:53:02.234 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:53:17.324 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:53:32.424 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:53:47.512 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:54:02.608 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-06-24T17:54:02.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:54:05.748 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-24T17:54:11.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:54:14.836 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-24T17:54:20.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:54:23.920 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-24T17:54:29.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:54:32.976 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-24T17:54:38.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:54:42.032 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-24T17:54:48.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:54:51.088 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-24T17:54:57.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:55:57.152 WARNING:teuthology.provision.fog.smithi184:timed out 2023-06-24T17:56:03.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:56:03.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-24T17:56:03.412 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-24T17:56:03.672 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-06-24T17:56:03.672 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-06-24T17:56:03.693 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-06-24T17:56:03.693 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-06-24T17:56:03.755 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-06-24T17:56:03.755 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-06-24T17:56:03.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-06-24T17:56:03.906 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-06-24T17:56:03.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-06-24T17:56:04.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-06-24T17:56:04.129 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-06-24T17:56:04.192 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T17:56:04.193 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-06-24T17:56:04.194 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T17:56:04.194 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-06-24T17:56:04.194 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T17:56:04.194 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T17:56:04.194 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T17:56:04.195 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-06-24T17:56:04.196 DEBUG:teuthology.parallel:result is None 2023-06-24T17:56:04.322 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-06-24T17:56:04.323 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-24T17:56:04.350 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-06-24T17:56:04.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-06-24T17:56:04.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-24T17:56:04.420 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-06-24T17:56:04.494 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-06-24T17:56:04.556 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-06-24T17:56:04.556 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-06-24T17:56:04.618 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2023-06-24T17:56:04.618 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8" 2023-06-24T17:56:04.618 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2023-06-24T17:56:04.618 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2023-06-24T17:56:04.618 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8" 2023-06-24T17:56:04.618 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-24T17:56:04.619 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-24T17:56:04.620 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-06-24T17:56:04.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T17:56:04.641 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T17:56:04.740 INFO:teuthology.dispatcher.supervisor:Running job 7314064 2023-06-24T17:56:04.740 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-06-23_19:56:03-rgw-pr-51700-distro-default-smithi/7314064 --name cbodley-2023-06-23_19:56:03-rgw-pr-51700-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/cbodley-2023-06-23_19:56:03-rgw-pr-51700-distro-default-smithi/7314064/orig.config.yaml 2023-06-24T17:56:04.744 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-06-23_19:56:03-rgw-pr-51700-distro-default-smithi/7314064 2023-06-24T17:56:04.745 INFO:teuthology.dispatcher.supervisor:Job PID: 25208 2023-06-24T17:56:04.745 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-24T17:58:04.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T17:58:04.846 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:00:05.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:00:05.013 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:02:05.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:02:05.181 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:04:05.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:04:05.357 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:06:05.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:06:05.531 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:08:05.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:08:05.691 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:10:05.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:10:05.863 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:12:06.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:12:06.074 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:14:06.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:14:06.246 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:16:06.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:16:06.421 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:18:06.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T18:18:06.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T18:18:06.669 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-24T18:18:06.752 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-24T18:18:06.752 INFO:teuthology.nuke:Checking targets against current locks 2023-06-24T18:18:06.799 DEBUG:teuthology.nuke:shortname: smithi184 2023-06-24T18:18:06.800 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-24T18:18:06.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-06-23_19:56:03-rgw-pr-51700-distro-default-smithi/7314064', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 17:50:54.253727', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQSzeAhgzHyVwQRp+eCaw2ET2gborh0rHj/Qmdi2uAih/ULnwqnEP9lVgKr+52jLxpxuMPiWNrA5eGysXrxr8fmS/osRUAdgNq04KWRa/sFHTONewPqZcv6ACjO/gC3bjIS2P0gDJu2kv38jXaUl+juGQQSQbdTG2uhe791pwHaj7DW1DQP/XQHKmXW9SW3mI3u392QMM8dTVF5sfpTxNUTeRbegfj7oeCZ7My4ZLKOQA9Yr7zNInLo0+zLy4GucU/+wzn0JclP46UY/BV8rNiC2AgnabJt+LkLwnqTP3snLZaP0WK4UjQNj0WLclL3qFgIEKdueRC0skrjpO7Gu5adx7rnFySLfVj1vnSZ4+pvKkg/LS2FQyOZYroBoto8o+h0zQYBh2q8n14s4OrZhVFM3DEt8sZ+e2hJ+0XOw6uboeG6bt7WPUdER6iGbIJof8cw6yYkHOIgPGzBdZA/WKaYGenjVbJGi+488Ana2KlHkJJXSUA1hCpCI9y4+m9ao8='} 2023-06-24T18:18:06.882 INFO:teuthology.orchestra.console:Power off smithi184 2023-06-24T18:18:06.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-24T18:18:06.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-24T18:18:07.028 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-06-24T18:18:07.185 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com