2023-09-19T09:25:12.201 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-19T09:25:12.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:25:12.303 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc35dbaed30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc35d947af0>, signals=[15])
2023-09-19T09:25:12.304 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2023-09-19T09:25:12.305 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2023-09-19T09:25:12.305 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-09-19T09:25:12.325 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"}
2023-09-19T09:25:12.388 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-09-19T09:25:12.421 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-09-19T09:25:12.421 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 6}
2023-09-19T09:25:12.461 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of ubuntu 22.04
2023-09-19T09:25:12.462 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:25:12.607 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"}
2023-09-19T09:25:12.642 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1}
2023-09-19T09:25:12.709 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:25:12.886 INFO:teuthology.orchestra.console.smithi164:Power off
2023-09-19T09:25:12.887 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-19T09:25:12.907 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2023-09-19T09:25:12.907 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T09:25:12.928 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-09-19T09:25:13.029 INFO:teuthology.orchestra.console.smithi164:Power off completed
2023-09-19T09:25:13.130 INFO:teuthology.orchestra.console.smithi164:Power on
2023-09-19T09:25:13.130 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-19T09:25:13.155 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On
2023-09-19T09:25:13.156 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T09:25:13.176 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-09-19T09:25:17.180 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T09:25:17.288 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2023-09-19T09:25:17.389 INFO:teuthology.orchestra.console.smithi164:Power on completed
2023-09-19T09:25:17.490 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2023-09-19T09:25:17.490 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:25:32.644 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:25:47.813 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:26:02.994 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:26:18.179 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:26:33.371 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:26:48.581 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:27:03.811 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:27:18.998 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:27:34.194 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:27:49.382 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:28:04.562 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:28:19.762 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:28:34.942 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:28:50.121 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:29:05.317 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:29:20.474 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:29:35.614 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:29:50.746 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:30:05.888 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:30:20.994 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:30:36.118 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:30:51.225 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:31:06.318 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:31:21.418 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:31:36.486 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-09-19T09:31:36.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:31:54.906 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-09-19T09:32:00.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:32:03.962 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-09-19T09:32:09.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:32:13.054 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-09-19T09:32:19.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:32:22.138 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-09-19T09:32:28.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:32:31.194 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-09-19T09:32:37.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:32:40.254 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-09-19T09:32:46.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:33:46.303 WARNING:teuthology.provision.fog.smithi164:timed out
2023-09-19T09:33:52.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:33:52.576 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-19T09:33:52.577 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-19T09:33:53.029 INFO:teuthology.provision.fog.smithi164:Node is ready
2023-09-19T09:33:53.029 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2023-09-19T09:33:53.076 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2023-09-19T09:33:53.077 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts
2023-09-19T09:33:53.125 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2023-09-19T09:33:53.126 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-09-19T09:33:53.271 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts
2023-09-19T09:33:53.285 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2023-09-19T09:33:53.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname
2023-09-19T09:33:53.397 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-09-19T09:33:53.456 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-09-19T09:33:53.505 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-19T09:33:53.505 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu"
2023-09-19T09:33:53.505 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04"
2023-09-19T09:33:53.506 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-19T09:33:53.506 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy
2023-09-19T09:33:53.506 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu
2023-09-19T09:33:53.506 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian
2023-09-19T09:33:53.506 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-19T09:33:53.507 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-19T09:33:53.507 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-19T09:33:53.507 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-19T09:33:53.507 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy
2023-09-19T09:33:53.508 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2023-09-19T09:33:53.509 DEBUG:teuthology.parallel:result is None
2023-09-19T09:33:53.658 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2023-09-19T09:33:53.659 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-19T09:33:53.691 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2023-09-19T09:33:53.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-09-19T09:33:53.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-19T09:33:53.761 DEBUG:teuthology.orchestra.run.smithi164:> true
2023-09-19T09:33:53.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-09-19T09:33:53.859 DEBUG:teuthology.orchestra.run.smithi164:> uname -m
2023-09-19T09:33:53.905 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2023-09-19T09:33:53.905 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-09-19T09:33:53.957 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-09-19T09:33:53.957 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu"
2023-09-19T09:33:53.958 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="22.04"
2023-09-19T09:33:53.958 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-09-19T09:33:53.958 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=jammy
2023-09-19T09:33:53.958 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu
2023-09-19T09:33:53.958 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian
2023-09-19T09:33:53.959 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/"
2023-09-19T09:33:53.959 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-09-19T09:33:53.959 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-09-19T09:33:53.959 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-09-19T09:33:53.959 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=jammy
2023-09-19T09:33:53.960 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-09-19T09:33:53.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:33:54.084 INFO:teuthology.dispatcher.supervisor:Running job 7397913
2023-09-19T09:33:54.085 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-09-19_09:23:18-rgw-rgw-wip-t62141-valg-supp_i005-distro-default-smithi/7397913 --name mkogan-2023-09-19_09:23:18-rgw-rgw-wip-t62141-valg-supp_i005-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} -- /home/teuthworker/archive/mkogan-2023-09-19_09:23:18-rgw-rgw-wip-t62141-valg-supp_i005-distro-default-smithi/7397913/orig.config.yaml
2023-09-19T09:33:54.087 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-09-19_09:23:18-rgw-rgw-wip-t62141-valg-supp_i005-distro-default-smithi/7397913
2023-09-19T09:33:54.088 INFO:teuthology.dispatcher.supervisor:Job PID: 2130430
2023-09-19T09:33:54.088 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-19T09:35:54.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:37:54.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:39:54.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:41:54.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:43:54.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:45:55.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:47:55.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-19T09:47:55.218 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-19T09:47:55.348 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-19T09:47:55.349 INFO:teuthology.nuke:Checking targets against current locks
2023-09-19T09:47:55.391 DEBUG:teuthology.nuke:shortname: smithi164
2023-09-19T09:47:55.391 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-19T09:47:55.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-09-19_09:23:18-rgw-rgw-wip-t62141-valg-supp_i005-distro-default-smithi/7397913', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-19 09:25:11.441367', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLUOOw+4u0wkuvv+tw3UdpHe8MWFWoGkGoW4swxsLxnapHRiD6KIinRr7Qnbaw1Mbvx9q910sLCFA2s02cwruM='}
2023-09-19T09:47:55.456 INFO:teuthology.orchestra.console.smithi164:Power off
2023-09-19T09:47:55.457 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-19T09:47:55.476 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2023-09-19T09:47:55.477 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-19T09:47:55.497 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-09-19T09:47:55.598 INFO:teuthology.orchestra.console.smithi164:Power off completed
2023-09-19T09:47:55.750 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com