2023-09-21T21:45:59.672 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T21:45:59.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T21:45:59.777 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f23ba507670>, signals=[15]) 2023-09-21T21:45:59.777 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-09-21T21:45:59.777 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T21:45:59.778 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-09-21T21:45:59.800 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-09-21T21:45:59.869 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-09-21T21:45:59.911 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-09-21T21:45:59.912 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 2} 2023-09-21T21:45:59.960 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04 2023-09-21T21:45:59.960 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:46:00.032 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T21:46:00.066 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-09-21T21:46:00.109 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:46:00.208 INFO:teuthology.orchestra.console.smithi083:Power off 2023-09-21T21:46:00.208 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T21:46:00.230 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-09-21T21:46:00.230 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T21:46:00.251 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-21T21:46:04.255 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T21:46:04.363 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-21T21:46:08.368 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T21:46:08.476 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-21T21:46:08.577 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-09-21T21:46:08.678 INFO:teuthology.orchestra.console.smithi083:Power on 2023-09-21T21:46:08.678 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T21:46:08.698 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2023-09-21T21:46:08.698 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T21:46:08.719 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-21T21:46:12.722 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T21:46:12.830 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-21T21:46:16.834 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T21:46:16.942 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-09-21T21:46:17.043 INFO:teuthology.orchestra.console.smithi083:Power on completed 2023-09-21T21:46:17.144 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-09-21T21:46:17.144 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:46:32.230 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:46:47.314 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:47:02.406 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:47:17.490 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:47:32.575 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:47:47.654 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:48:02.723 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:48:17.797 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:48:32.871 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:48:47.937 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:49:02.999 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:49:18.071 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:49:33.145 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:49:48.202 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:50:03.266 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-09-21T21:50:03.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:50:21.818 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-21T21:50:27.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:50:30.878 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-21T21:50:36.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:50:40.033 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-21T21:50:46.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:50:49.118 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-09-21T21:50:55.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:51:55.182 WARNING:teuthology.provision.fog.smithi083:timed out 2023-09-21T21:52:01.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:52:01.396 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T21:52:01.396 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T21:52:01.873 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-09-21T21:52:01.874 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-09-21T21:52:01.880 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-09-21T21:52:01.880 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-09-21T21:52:01.888 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-09-21T21:52:01.888 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-09-21T21:52:01.969 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-09-21T21:52:01.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-09-21T21:52:02.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-09-21T21:52:02.013 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-09-21T21:52:02.023 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-09-21T21:52:02.071 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-09-21T21:52:02.071 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-21T21:52:02.071 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-09-21T21:52:02.071 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-09-21T21:52:02.071 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-09-21T21:52:02.072 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-09-21T21:52:02.073 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-09-21T21:52:02.074 DEBUG:teuthology.parallel:result is None 2023-09-21T21:52:02.258 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-09-21T21:52:02.258 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T21:52:02.288 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-09-21T21:52:02.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-09-21T21:52:02.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T21:52:02.338 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-09-21T21:52:02.459 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-09-21T21:52:02.460 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-09-21T21:52:02.466 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-09-21T21:52:02.466 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-09-21T21:52:02.472 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-09-21T21:52:02.472 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-21T21:52:02.472 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-09-21T21:52:02.472 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-09-21T21:52:02.473 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-09-21T21:52:02.473 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-09-21T21:52:02.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T21:52:02.578 INFO:teuthology.dispatcher.supervisor:Running job 7400386 2023-09-21T21:52:02.579 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cfsnyder@teuthology --archive /home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400386 --name cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi --description rgw/dbstore/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{ubuntu_20.04} tasks/rgw_s3tests} -- /home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400386/orig.config.yaml 2023-09-21T21:52:02.581 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400386 2023-09-21T21:52:02.582 INFO:teuthology.dispatcher.supervisor:Job PID: 1524142 2023-09-21T21:52:02.582 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-21T21:54:02.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T21:56:02.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T21:58:02.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:00:03.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:02:03.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:04:03.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:06:03.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:08:03.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:10:03.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:12:04.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T22:12:04.135 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-21T22:12:04.283 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-21T22:12:04.284 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T22:12:04.330 DEBUG:teuthology.nuke:shortname: smithi083 2023-09-21T22:12:04.330 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T22:12:04.349 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cfsnyder-2023-09-21_21:27:43-rgw-wip-62075-distro-default-smithi/7400386', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 21:45:58.941413', 'locked_by': 'scheduled_cfsnyder@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-21T22:12:04.394 INFO:teuthology.orchestra.console.smithi083:Power off 2023-09-21T22:12:04.395 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T22:12:04.415 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-09-21T22:12:04.415 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T22:12:04.438 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-09-21T22:12:04.539 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-09-21T22:12:04.692 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com