2026-02-25T19:31:51.230 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-25T19:31:51.230 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:31:51.304 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:31:51.433 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7a2c50c0e840>, signals=[15]) 2026-02-25T19:31:51.433 INFO:teuthology.lock.ops:Start node 'trial124.front.sepia.ceph.com' reimaging 2026-02-25T19:31:51.433 INFO:teuthology.lock.ops:Updating [trial124.front.sepia.ceph.com]: reset os type and version on server 2026-02-25T19:31:51.433 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server 2026-02-25T19:31:51.610 DEBUG:teuthology.provision.fog.trial124:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-25T19:31:51.656 INFO:teuthology.provision.fog.trial124:Scheduling deploy of ubuntu 22.04 2026-02-25T19:31:55.696 INFO:teuthology.orchestra.console.trial124:Power off 2026-02-25T19:31:55.697 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T19:31:55.739 DEBUG:teuthology.orchestra.console.trial124:power off output: Chassis Power Control: Down/Off 2026-02-25T19:31:59.743 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T19:31:59.852 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is off 2026-02-25T19:31:59.853 INFO:teuthology.orchestra.console.trial124:Power off completed 2026-02-25T19:31:59.953 INFO:teuthology.orchestra.console.trial124:Power on 2026-02-25T19:31:59.953 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-25T19:31:59.995 DEBUG:teuthology.orchestra.console.trial124:power on output: Chassis Power Control: Up/On 2026-02-25T19:32:03.999 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T19:32:04.107 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is on 2026-02-25T19:32:04.107 INFO:teuthology.orchestra.console.trial124:Power on completed 2026-02-25T19:32:04.207 INFO:teuthology.provision.fog.trial124:Waiting for deploy to finish 2026-02-25T19:35:45.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T19:35:48.545 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124 2026-02-25T19:35:54.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T19:35:57.632 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124 2026-02-25T19:36:03.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T19:36:06.720 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124 2026-02-25T19:36:12.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T19:36:15.809 WARNING:teuthology.provision.fog.trial124:[Errno None] Unable to connect to port 22 on 10.20.193.124 2026-02-25T19:36:21.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T19:36:57.577 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-25T19:36:57.577 DEBUG:teuthology.orchestra.run.trial124:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-25T19:36:57.990 INFO:teuthology.provision.fog.trial124:Node is ready 2026-02-25T19:36:57.990 DEBUG:teuthology.orchestra.run.trial124:> hostname 2026-02-25T19:36:58.033 INFO:teuthology.orchestra.run.trial124.stdout:trial124.front.sepia.ceph.com 2026-02-25T19:36:58.034 DEBUG:teuthology.orchestra.run.trial124:> grep trial124.front.sepia.ceph.com /etc/hosts 2026-02-25T19:36:58.078 INFO:teuthology.orchestra.run.trial124.stdout:10.20.193.124 trial124.front.sepia.ceph.com trial124 2026-02-25T19:36:58.078 DEBUG:teuthology.orchestra.run.trial124:> sudo hostname trial124 2026-02-25T19:36:58.128 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/trial124.front.sepia.ceph.com/trial124/g' /etc/hosts 2026-02-25T19:36:58.178 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/10.20.193.124/10.20.193.124/g' /etc/hosts 2026-02-25T19:36:58.226 DEBUG:teuthology.orchestra.run.trial124:> sudo sed -i -e 's/trial124.front.sepia.ceph.com/trial124/g' /etc/hostname 2026-02-25T19:36:58.278 DEBUG:teuthology.orchestra.run.trial124:> sudo hostname trial124 2026-02-25T19:36:58.330 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:NAME="Ubuntu" 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="22.04" 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_CODENAME=jammy 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:ID=ubuntu 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE=debian 2026-02-25T19:36:58.374 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T19:36:58.375 INFO:teuthology.orchestra.run.trial124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T19:36:58.375 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T19:36:58.375 INFO:teuthology.orchestra.run.trial124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T19:36:58.375 INFO:teuthology.orchestra.run.trial124.stdout:UBUNTU_CODENAME=jammy 2026-02-25T19:36:58.375 INFO:teuthology.provision.fog.trial124:Deploy complete! 2026-02-25T19:36:58.376 DEBUG:teuthology.parallel:result is None 2026-02-25T19:36:58.709 INFO:teuthology.lock.ops:Checking trial124.front.sepia.ceph.com 2026-02-25T19:36:58.710 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-25T19:36:58.785 INFO:teuthology.lock.ops:Updating [trial124.front.sepia.ceph.com]: set os type and version on server 2026-02-25T19:36:58.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-25T19:36:58.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T19:36:58.849 DEBUG:teuthology.orchestra.run.trial124:> true 2026-02-25T19:36:58.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial124.front.sepia.ceph.com' 2026-02-25T19:36:58.930 DEBUG:teuthology.orchestra.run.trial124:> uname -m 2026-02-25T19:36:58.973 INFO:teuthology.orchestra.run.trial124.stdout:x86_64 2026-02-25T19:36:58.973 DEBUG:teuthology.orchestra.run.trial124:> cat /etc/os-release 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:NAME="Ubuntu" 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_ID="22.04" 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:VERSION_CODENAME=jammy 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:ID=ubuntu 2026-02-25T19:36:59.018 INFO:teuthology.orchestra.run.trial124.stdout:ID_LIKE=debian 2026-02-25T19:36:59.019 INFO:teuthology.orchestra.run.trial124.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-25T19:36:59.019 INFO:teuthology.orchestra.run.trial124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-25T19:36:59.019 INFO:teuthology.orchestra.run.trial124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-25T19:36:59.019 INFO:teuthology.orchestra.run.trial124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-25T19:36:59.019 INFO:teuthology.orchestra.run.trial124.stdout:UBUNTU_CODENAME=jammy 2026-02-25T19:36:59.019 INFO:teuthology.lock.ops:Updating trial124.front.sepia.ceph.com on lock server 2026-02-25T19:36:59.122 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:36:59.317 INFO:teuthology.dispatcher.supervisor:Running job 70549 2026-02-25T19:36:59.317 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/bin/teuthology -v --owner scheduled_aemerson@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70549 --name aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability overrides s3tests-branch ubuntu_latest} -- /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70549/orig.config.yaml 2026-02-25T19:36:59.317 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/aemerson-2026-02-25_19:29:50-rgw-wip-rocky10-branch-of-the-day-2026-02-24-1771941190-distro-default-trial/70549 2026-02-25T19:36:59.318 INFO:teuthology.dispatcher.supervisor:Job PID: 3420544 2026-02-25T19:36:59.318 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-25T19:38:59.417 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:40:59.593 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:42:59.680 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:44:59.835 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:46:59.972 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:49:00.111 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:51:00.299 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:53:00.464 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:55:00.575 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:57:00.667 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:59:00.759 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T19:59:00.844 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-25T19:59:00.903 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-25T19:59:01.200 INFO:teuthology.orchestra.console.trial124:Power off 2026-02-25T19:59:01.200 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-25T19:59:01.237 DEBUG:teuthology.orchestra.console.trial124:power off output: Chassis Power Control: Down/Off 2026-02-25T19:59:05.242 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T19:59:05.350 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is on 2026-02-25T19:59:09.354 DEBUG:teuthology.orchestra.console.trial124:pexpect command: ipmitool -H trial124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-25T19:59:09.463 DEBUG:teuthology.orchestra.console.trial124:check power output: Chassis Power is off 2026-02-25T19:59:09.464 INFO:teuthology.orchestra.console.trial124:Power off completed 2026-02-25T19:59:09.673 INFO:teuthology.lock.ops:unlocked: trial124.front.sepia.ceph.com