2023-10-10T21:25:12.696 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-10T21:25:12.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:25:12.810 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb58c5ffbe0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb58d0ea670>, signals=[15])
2023-10-10T21:25:12.811 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging
2023-10-10T21:25:12.812 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server
2023-10-10T21:25:12.812 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2023-10-10T21:25:12.831 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"}
2023-10-10T21:25:12.904 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-10-10T21:25:12.946 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-10-10T21:25:12.947 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 2}
2023-10-10T21:25:12.984 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04
2023-10-10T21:25:12.985 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:25:13.039 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"}
2023-10-10T21:25:13.079 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1}
2023-10-10T21:25:13.140 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:25:13.235 INFO:teuthology.orchestra.console.smithi083:Power off
2023-10-10T21:25:13.238 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T21:25:13.261 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off
2023-10-10T21:25:13.261 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:25:13.287 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2023-10-10T21:25:17.290 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:25:17.399 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2023-10-10T21:25:21.402 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:25:21.514 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2023-10-10T21:25:25.518 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:25:25.627 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2023-10-10T21:25:25.728 INFO:teuthology.orchestra.console.smithi083:Power off completed
2023-10-10T21:25:25.828 INFO:teuthology.orchestra.console.smithi083:Power on
2023-10-10T21:25:25.829 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-10T21:25:25.851 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On
2023-10-10T21:25:25.852 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:25:25.885 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2023-10-10T21:25:29.890 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:25:29.999 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2023-10-10T21:25:30.100 INFO:teuthology.orchestra.console.smithi083:Power on completed
2023-10-10T21:25:30.201 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2023-10-10T21:25:30.202 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:25:45.283 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:26:00.362 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:26:15.438 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:26:30.518 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:26:45.590 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:27:00.670 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:27:15.750 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:27:30.850 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:27:45.938 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:28:01.039 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:28:16.117 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:28:31.210 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:28:46.286 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:29:01.384 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:29:16.477 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None
2023-10-10T21:29:16.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:29:19.610 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-10-10T21:29:25.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:29:28.666 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-10-10T21:29:34.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:29:37.726 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-10-10T21:29:43.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:29:46.810 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-10-10T21:29:52.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:29:55.866 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-10-10T21:30:01.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:30:04.922 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2023-10-10T21:30:10.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:31:10.987 WARNING:teuthology.provision.fog.smithi083:timed out
2023-10-10T21:31:16.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:31:17.210 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-10T21:31:17.211 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-10T21:31:17.703 INFO:teuthology.provision.fog.smithi083:Node is ready
2023-10-10T21:31:17.704 DEBUG:teuthology.orchestra.run.smithi083:> hostname
2023-10-10T21:31:17.750 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com
2023-10-10T21:31:17.751 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts
2023-10-10T21:31:17.757 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083
2023-10-10T21:31:17.757 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2023-10-10T21:31:17.840 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts
2023-10-10T21:31:17.856 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts
2023-10-10T21:31:17.871 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname
2023-10-10T21:31:17.927 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2023-10-10T21:31:17.938 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2023-10-10T21:31:17.943 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu"
2023-10-10T21:31:17.943 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-10T21:31:17.944 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu
2023-10-10T21:31:17.944 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian
2023-10-10T21:31:17.944 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-10T21:31:17.944 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04"
2023-10-10T21:31:17.944 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-10T21:31:17.945 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-10T21:31:17.945 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-10T21:31:17.945 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-10T21:31:17.945 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal
2023-10-10T21:31:17.946 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal
2023-10-10T21:31:17.946 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2023-10-10T21:31:17.948 DEBUG:teuthology.parallel:result is None
2023-10-10T21:31:18.110 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com
2023-10-10T21:31:18.113 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server
2023-10-10T21:31:18.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-10-10T21:31:18.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:31:18.165 DEBUG:teuthology.orchestra.run.smithi083:> true
2023-10-10T21:31:18.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com'
2023-10-10T21:31:18.292 DEBUG:teuthology.orchestra.run.smithi083:> uname -m
2023-10-10T21:31:18.298 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64
2023-10-10T21:31:18.299 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2023-10-10T21:31:18.346 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu"
2023-10-10T21:31:18.346 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-10-10T21:31:18.347 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu
2023-10-10T21:31:18.347 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian
2023-10-10T21:31:18.347 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-10-10T21:31:18.347 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04"
2023-10-10T21:31:18.347 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/"
2023-10-10T21:31:18.348 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-10-10T21:31:18.348 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-10-10T21:31:18.348 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-10-10T21:31:18.348 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal
2023-10-10T21:31:18.348 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal
2023-10-10T21:31:18.349 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2023-10-10T21:31:18.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:31:18.464 INFO:teuthology.dispatcher.supervisor:Running job 7420562
2023-10-10T21:31:18.464 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-10-10_20:48:39-rgw-main-distro-default-smithi/7420562 --name cbodley-2023-10-10_20:48:39-rgw-main-distro-default-smithi --description rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_20.04} tasks/rgw_s3tests} -- /home/teuthworker/archive/cbodley-2023-10-10_20:48:39-rgw-main-distro-default-smithi/7420562/orig.config.yaml
2023-10-10T21:31:18.467 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-10-10_20:48:39-rgw-main-distro-default-smithi/7420562
2023-10-10T21:31:18.468 INFO:teuthology.dispatcher.supervisor:Job PID: 1605902
2023-10-10T21:31:18.468 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-10T21:33:18.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:35:18.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:37:18.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:39:19.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:41:19.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:43:19.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:45:19.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:47:19.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:49:19.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:51:20.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:53:20.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:55:20.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:57:20.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:59:20.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:01:20.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:03:21.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:05:21.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:07:21.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:09:21.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:11:21.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:13:21.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:15:22.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:17:22.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:19:22.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:21:22.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:23:22.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:25:22.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:27:23.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:29:23.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:31:23.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:33:23.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:35:23.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:37:23.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T22:37:23.966 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-10T22:37:24.047 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/dis-2023-10-10_21:40:56-rbd-wip-dis-testing-distro-default-smithi/7420745