2026-02-25T19:31:59.631 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce
2026-02-25T19:31:59.632 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:31:59.704 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:31:59.836 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7d851a667740>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7d8519e99580>, signals=[15])
2026-02-25T19:31:59.836 INFO:teuthology.lock.ops:Start node 'trial166.front.sepia.ceph.com' reimaging
2026-02-25T19:31:59.836 INFO:teuthology.lock.ops:Updating [trial166.front.sepia.ceph.com]: reset os type and version on server
2026-02-25T19:31:59.836 INFO:teuthology.lock.ops:Updating trial166.front.sepia.ceph.com on lock server
2026-02-25T19:32:00.002 DEBUG:teuthology.provision.fog.trial166:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-25T19:32:00.033 INFO:teuthology.provision.fog.trial166:Scheduling deploy of ubuntu 22.04
2026-02-25T19:32:03.899 INFO:teuthology.orchestra.console.trial166:Power off
2026-02-25T19:32:03.899 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T19:32:03.944 DEBUG:teuthology.orchestra.console.trial166:power off output: Chassis Power Control: Down/Off
2026-02-25T19:32:07.949 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T19:32:08.060 DEBUG:teuthology.orchestra.console.trial166:check power output: Chassis Power is off
2026-02-25T19:32:08.060 INFO:teuthology.orchestra.console.trial166:Power off completed
2026-02-25T19:32:08.160 INFO:teuthology.orchestra.console.trial166:Power on
2026-02-25T19:32:08.161 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-25T19:32:08.213 DEBUG:teuthology.orchestra.console.trial166:power on output: Chassis Power Control: Up/On
2026-02-25T19:32:12.218 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T19:32:12.328 DEBUG:teuthology.orchestra.console.trial166:check power output: Chassis Power is on
2026-02-25T19:32:12.329 INFO:teuthology.orchestra.console.trial166:Power on completed
2026-02-25T19:32:12.429 INFO:teuthology.provision.fog.trial166:Waiting for deploy to finish
2026-02-25T19:35:25.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T19:35:28.448 WARNING:teuthology.provision.fog.trial166:[Errno None] Unable to connect to port 22 on 10.20.193.166
2026-02-25T19:35:34.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T19:35:37.536 WARNING:teuthology.provision.fog.trial166:[Errno None] Unable to connect to port 22 on 10.20.193.166
2026-02-25T19:35:43.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T19:35:46.624 WARNING:teuthology.provision.fog.trial166:[Errno None] Unable to connect to port 22 on 10.20.193.166
2026-02-25T19:35:52.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T19:35:55.713 WARNING:teuthology.provision.fog.trial166:[Errno None] Unable to connect to port 22 on 10.20.193.166
2026-02-25T19:36:01.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T19:36:37.623 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-25T19:36:37.624 DEBUG:teuthology.orchestra.run.trial166:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-25T19:36:43.147 INFO:teuthology.provision.fog.trial166:Node is ready
2026-02-25T19:36:43.148 DEBUG:teuthology.orchestra.run.trial166:> hostname
2026-02-25T19:36:43.153 INFO:teuthology.orchestra.run.trial166.stdout:trial166.front.sepia.ceph.com
2026-02-25T19:36:43.153 DEBUG:teuthology.orchestra.run.trial166:> grep trial166.front.sepia.ceph.com /etc/hosts
2026-02-25T19:36:43.199 INFO:teuthology.orchestra.run.trial166.stdout:10.20.193.166 trial166.front.sepia.ceph.com trial166
2026-02-25T19:36:43.199 DEBUG:teuthology.orchestra.run.trial166:> sudo hostname trial166
2026-02-25T19:36:43.254 DEBUG:teuthology.orchestra.run.trial166:> sudo sed -i -e 's/trial166.front.sepia.ceph.com/trial166/g' /etc/hosts
2026-02-25T19:36:43.303 DEBUG:teuthology.orchestra.run.trial166:> sudo sed -i -e 's/10.20.193.166/10.20.193.166/g' /etc/hosts
2026-02-25T19:36:43.355 DEBUG:teuthology.orchestra.run.trial166:> sudo sed -i -e 's/trial166.front.sepia.ceph.com/trial166/g' /etc/hostname
2026-02-25T19:36:43.403 DEBUG:teuthology.orchestra.run.trial166:> sudo hostname trial166
2026-02-25T19:36:43.454 DEBUG:teuthology.orchestra.run.trial166:> cat /etc/os-release
2026-02-25T19:36:43.498 INFO:teuthology.orchestra.run.trial166.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:NAME="Ubuntu"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:VERSION_ID="22.04"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:VERSION_CODENAME=jammy
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:ID=ubuntu
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:ID_LIKE=debian
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-25T19:36:43.499 INFO:teuthology.orchestra.run.trial166.stdout:UBUNTU_CODENAME=jammy
2026-02-25T19:36:43.500 INFO:teuthology.provision.fog.trial166:Deploy complete!
2026-02-25T19:36:43.501 DEBUG:teuthology.parallel:result is None
2026-02-25T19:36:43.834 INFO:teuthology.lock.ops:Checking trial166.front.sepia.ceph.com
2026-02-25T19:36:43.834 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-25T19:36:43.922 INFO:teuthology.lock.ops:Updating [trial166.front.sepia.ceph.com]: set os type and version on server
2026-02-25T19:36:43.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial166.front.sepia.ceph.com'
2026-02-25T19:36:43.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-25T19:36:43.989 DEBUG:teuthology.orchestra.run.trial166:> true
2026-02-25T19:36:44.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial166.front.sepia.ceph.com'
2026-02-25T19:36:44.069 DEBUG:teuthology.orchestra.run.trial166:> uname -m
2026-02-25T19:36:44.114 INFO:teuthology.orchestra.run.trial166.stdout:x86_64
2026-02-25T19:36:44.114 DEBUG:teuthology.orchestra.run.trial166:> cat /etc/os-release
2026-02-25T19:36:44.158 INFO:teuthology.orchestra.run.trial166.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:NAME="Ubuntu"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:VERSION_ID="22.04"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:VERSION_CODENAME=jammy
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:ID=ubuntu
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:ID_LIKE=debian
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-25T19:36:44.159 INFO:teuthology.orchestra.run.trial166.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-25T19:36:44.160 INFO:teuthology.orchestra.run.trial166.stdout:UBUNTU_CODENAME=jammy
2026-02-25T19:36:44.160 INFO:teuthology.lock.ops:Updating trial166.front.sepia.ceph.com on lock server
2026-02-25T19:36:44.261 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:36:44.352 INFO:teuthology.dispatcher.supervisor:Running job 70567
2026-02-25T19:36:44.352 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/bin/teuthology -v --owner scheduled_aemerson@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70567 --name aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} -- /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70567/orig.config.yaml
2026-02-25T19:36:44.352 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70567
2026-02-25T19:36:44.352 INFO:teuthology.dispatcher.supervisor:Job PID: 3420355
2026-02-25T19:36:44.352 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-25T19:38:44.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:40:44.569 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:42:44.712 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:44:44.915 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:46:45.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:48:45.289 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:50:45.503 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:52:45.648 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:54:45.838 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:56:46.014 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T19:58:46.188 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T20:00:46.351 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-25T20:00:46.438 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-25T20:00:46.499 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-25T20:00:46.787 INFO:teuthology.orchestra.console.trial166:Power off
2026-02-25T20:00:46.787 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-25T20:00:46.825 DEBUG:teuthology.orchestra.console.trial166:power off output: Chassis Power Control: Down/Off
2026-02-25T20:00:50.829 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T20:00:50.937 DEBUG:teuthology.orchestra.console.trial166:check power output: Chassis Power is on
2026-02-25T20:00:54.941 DEBUG:teuthology.orchestra.console.trial166:pexpect command: ipmitool -H trial166.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-25T20:00:55.051 DEBUG:teuthology.orchestra.console.trial166:check power output: Chassis Power is off
2026-02-25T20:00:55.051 INFO:teuthology.orchestra.console.trial166:Power off completed
2026-02-25T20:00:55.259 INFO:teuthology.lock.ops:unlocked: trial166.front.sepia.ceph.com