2023-06-29T19:35:02.138 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39
2023-06-29T19:35:02.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:35:02.140 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:35:02.256 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3cd4285640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3cd3be85e0>, signals=[15])
2023-06-29T19:35:02.258 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging
2023-06-29T19:35:02.258 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server
2023-06-29T19:35:02.258 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2023-06-29T19:35:02.297 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"}
2023-06-29T19:35:02.377 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-06-29T19:35:02.426 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-06-29T19:35:02.427 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 2}
2023-06-29T19:35:02.470 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of ubuntu 20.04
2023-06-29T19:35:02.470 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:35:02.551 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"}
2023-06-29T19:35:02.594 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1}
2023-06-29T19:35:02.659 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:35:02.770 INFO:teuthology.orchestra.console:Power off smithi193
2023-06-29T19:35:02.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-29T19:35:02.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T19:35:02.913 INFO:teuthology.orchestra.console:Power off for smithi193 completed
2023-06-29T19:35:03.014 INFO:teuthology.orchestra.console:Power on smithi193
2023-06-29T19:35:03.015 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-29T19:35:03.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T19:35:07.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T19:35:07.284 INFO:teuthology.orchestra.console:Power on for smithi193 completed
2023-06-29T19:35:07.385 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish
2023-06-29T19:35:07.386 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:35:22.484 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:35:37.588 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:35:52.692 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:36:07.784 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:36:22.888 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:36:37.996 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:36:53.100 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:37:08.200 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:37:23.292 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:37:38.399 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:37:53.504 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:38:08.608 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:38:23.701 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:38:38.790 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:38:53.884 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-29T19:38:53.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:38:57.040 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-29T19:39:03.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:39:06.128 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-29T19:39:12.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:39:15.184 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-29T19:39:21.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:39:24.244 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-29T19:39:30.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:39:33.328 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-29T19:39:39.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:39:42.388 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-29T19:39:48.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:40:48.454 WARNING:teuthology.provision.fog.smithi193:timed out
2023-06-29T19:40:54.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:40:54.677 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-29T19:40:54.678 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-29T19:40:55.182 INFO:teuthology.provision.fog.smithi193:Node is ready
2023-06-29T19:40:55.183 DEBUG:teuthology.orchestra.run.smithi193:> hostname
2023-06-29T19:40:55.230 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com
2023-06-29T19:40:55.231 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts
2023-06-29T19:40:55.238 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2023-06-29T19:40:55.239 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2023-06-29T19:40:55.320 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts
2023-06-29T19:40:55.336 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts
2023-06-29T19:40:55.348 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname
2023-06-29T19:40:55.408 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2023-06-29T19:40:55.422 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2023-06-29T19:40:55.429 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu"
2023-06-29T19:40:55.429 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-06-29T19:40:55.430 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu
2023-06-29T19:40:55.430 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian
2023-06-29T19:40:55.430 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-06-29T19:40:55.430 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="20.04"
2023-06-29T19:40:55.431 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/"
2023-06-29T19:40:55.432 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-06-29T19:40:55.432 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-06-29T19:40:55.433 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-06-29T19:40:55.433 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=focal
2023-06-29T19:40:55.433 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=focal
2023-06-29T19:40:55.434 INFO:teuthology.provision.fog.smithi193:Deploy complete!
2023-06-29T19:40:55.436 DEBUG:teuthology.parallel:result is None
2023-06-29T19:40:55.637 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com
2023-06-29T19:40:55.638 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-29T19:40:55.667 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server
2023-06-29T19:40:55.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com'
2023-06-29T19:40:55.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T19:40:55.720 DEBUG:teuthology.orchestra.run.smithi193:> true
2023-06-29T19:40:55.842 DEBUG:teuthology.orchestra.run.smithi193:> uname -m
2023-06-29T19:40:55.896 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64
2023-06-29T19:40:55.896 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2023-06-29T19:40:55.902 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu"
2023-06-29T19:40:55.903 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-06-29T19:40:55.903 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu
2023-06-29T19:40:55.903 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian
2023-06-29T19:40:55.903 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="20.04"
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/"
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=focal
2023-06-29T19:40:55.904 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=focal
2023-06-29T19:40:55.905 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2023-06-29T19:40:55.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:40:55.931 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:40:56.036 INFO:teuthology.dispatcher.supervisor:Running job 7321441
2023-06-29T19:40:56.036 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-06-29_13:40:52-rgw-main-distro-default-smithi/7321441 --name cbodley-2023-06-29_13:40:52-rgw-main-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch supported-random-distro$/{ubuntu_20.04}} -- /home/teuthworker/archive/cbodley-2023-06-29_13:40:52-rgw-main-distro-default-smithi/7321441/orig.config.yaml
2023-06-29T19:40:56.040 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-06-29_13:40:52-rgw-main-distro-default-smithi/7321441
2023-06-29T19:40:56.040 INFO:teuthology.dispatcher.supervisor:Job PID: 4167
2023-06-29T19:40:56.041 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-29T19:42:56.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:42:56.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:44:56.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:44:56.311 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:46:56.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:46:56.494 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:48:56.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:48:56.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:50:56.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:50:56.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:52:57.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:52:57.037 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:54:57.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:54:57.204 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:56:57.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:56:57.374 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:58:57.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:58:57.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T20:00:57.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T20:00:57.731 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T20:02:57.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T20:02:57.902 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T20:04:58.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T20:04:58.081 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T20:04:58.143 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-29T20:04:58.237 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-29T20:04:58.237 INFO:teuthology.nuke:Checking targets against current locks
2023-06-29T20:04:58.292 DEBUG:teuthology.nuke:shortname: smithi193
2023-06-29T20:04:58.293 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-29T20:04:58.321 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-06-29_13:40:52-rgw-main-distro-default-smithi/7321441', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:35:01.315745', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-06-29T20:04:58.383 INFO:teuthology.orchestra.console:Power off smithi193
2023-06-29T20:04:58.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-29T20:04:58.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T20:04:58.536 INFO:teuthology.orchestra.console:Power off for smithi193 completed
2023-06-29T20:04:58.695 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com