2026-02-24T10:45:15.523 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-24T10:45:15.523 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:45:15.763 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:45:15.965 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x79ce0d379070>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x79ce0cb96ac0>, signals=[15])
2026-02-24T10:45:15.965 INFO:teuthology.lock.ops:Start node 'trial054.front.sepia.ceph.com' reimaging
2026-02-24T10:45:15.965 INFO:teuthology.lock.ops:Updating [trial054.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T10:45:15.965 INFO:teuthology.lock.ops:Updating trial054.front.sepia.ceph.com on lock server
2026-02-24T10:45:16.022 INFO:teuthology.lock.ops:Start node 'trial129.front.sepia.ceph.com' reimaging
2026-02-24T10:45:16.022 INFO:teuthology.lock.ops:Updating [trial129.front.sepia.ceph.com]: reset os type and version on server
2026-02-24T10:45:16.022 INFO:teuthology.lock.ops:Updating trial129.front.sepia.ceph.com on lock server
2026-02-24T10:45:16.260 DEBUG:teuthology.provision.fog.trial054:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T10:45:16.310 INFO:teuthology.provision.fog.trial054:Scheduling deploy of ubuntu 22.04
2026-02-24T10:45:16.416 DEBUG:teuthology.provision.fog.trial129:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-24T10:45:16.470 INFO:teuthology.provision.fog.trial129:Scheduling deploy of ubuntu 22.04
2026-02-24T10:45:17.554 INFO:teuthology.orchestra.console.trial054:Power off
2026-02-24T10:45:17.554 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T10:45:17.594 DEBUG:teuthology.orchestra.console.trial054:power off output: Chassis Power Control: Down/Off
2026-02-24T10:45:17.804 INFO:teuthology.orchestra.console.trial129:Power off
2026-02-24T10:45:17.804 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T10:45:17.854 DEBUG:teuthology.orchestra.console.trial129:power off output: Chassis Power Control: Down/Off
2026-02-24T10:45:21.598 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T10:45:21.709 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is off
2026-02-24T10:45:21.709 INFO:teuthology.orchestra.console.trial054:Power off completed
2026-02-24T10:45:21.810 INFO:teuthology.orchestra.console.trial054:Power on
2026-02-24T10:45:21.810 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T10:45:21.852 DEBUG:teuthology.orchestra.console.trial054:power on output: Chassis Power Control: Up/On
2026-02-24T10:45:21.856 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T10:45:21.966 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is off
2026-02-24T10:45:21.966 INFO:teuthology.orchestra.console.trial129:Power off completed
2026-02-24T10:45:22.067 INFO:teuthology.orchestra.console.trial129:Power on
2026-02-24T10:45:22.067 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-24T10:45:22.107 DEBUG:teuthology.orchestra.console.trial129:power on output: Chassis Power Control: Up/On
2026-02-24T10:45:25.856 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T10:45:25.967 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is off
2026-02-24T10:45:26.108 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T10:45:26.218 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is on
2026-02-24T10:45:26.219 INFO:teuthology.orchestra.console.trial129:Power on completed
2026-02-24T10:45:26.319 INFO:teuthology.provision.fog.trial129:Waiting for deploy to finish
2026-02-24T10:45:29.972 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T10:45:30.082 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is on
2026-02-24T10:45:30.082 INFO:teuthology.orchestra.console.trial054:Power on completed
2026-02-24T10:45:30.183 INFO:teuthology.provision.fog.trial054:Waiting for deploy to finish
2026-02-24T10:47:17.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:47:18.014 ERROR:teuthology.orchestra.connection:Error authenticating with trial054.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2026-02-24T10:47:29.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:47:32.544 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-24T10:47:38.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:47:41.632 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-24T10:47:47.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:47:50.720 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-24T10:47:56.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:47:59.808 WARNING:teuthology.provision.fog.trial129:[Errno None] Unable to connect to port 22 on 10.20.193.129
2026-02-24T10:48:05.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:48:22.018 WARNING:teuthology.provision.fog.trial054:timed out
2026-02-24T10:48:28.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:48:39.459 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T10:48:39.460 DEBUG:teuthology.orchestra.run.trial054:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T10:48:39.888 INFO:teuthology.provision.fog.trial054:Node is ready
2026-02-24T10:48:39.888 DEBUG:teuthology.orchestra.run.trial054:> hostname
2026-02-24T10:48:39.937 INFO:teuthology.orchestra.run.trial054.stdout:trial054.front.sepia.ceph.com
2026-02-24T10:48:39.938 DEBUG:teuthology.orchestra.run.trial054:> grep trial054.front.sepia.ceph.com /etc/hosts
2026-02-24T10:48:39.982 INFO:teuthology.orchestra.run.trial054.stdout:10.20.193.54 trial054.front.sepia.ceph.com trial054
2026-02-24T10:48:39.983 DEBUG:teuthology.orchestra.run.trial054:> sudo hostname trial054
2026-02-24T10:48:40.040 DEBUG:teuthology.orchestra.run.trial054:> sudo sed -i -e 's/trial054.front.sepia.ceph.com/trial054/g' /etc/hosts
2026-02-24T10:48:40.092 DEBUG:teuthology.orchestra.run.trial054:> sudo sed -i -e 's/10.20.193.54/10.20.193.54/g' /etc/hosts
2026-02-24T10:48:40.142 DEBUG:teuthology.orchestra.run.trial054:> sudo sed -i -e 's/trial054.front.sepia.ceph.com/trial054/g' /etc/hostname
2026-02-24T10:48:40.198 DEBUG:teuthology.orchestra.run.trial054:> sudo hostname trial054
2026-02-24T10:48:40.250 DEBUG:teuthology.orchestra.run.trial054:> cat /etc/os-release
2026-02-24T10:48:40.298 INFO:teuthology.orchestra.run.trial054.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T10:48:40.298 INFO:teuthology.orchestra.run.trial054.stdout:NAME="Ubuntu"
2026-02-24T10:48:40.298 INFO:teuthology.orchestra.run.trial054.stdout:VERSION_ID="22.04"
2026-02-24T10:48:40.298 INFO:teuthology.orchestra.run.trial054.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T10:48:40.298 INFO:teuthology.orchestra.run.trial054.stdout:VERSION_CODENAME=jammy
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:ID=ubuntu
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:ID_LIKE=debian
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T10:48:40.299 INFO:teuthology.orchestra.run.trial054.stdout:UBUNTU_CODENAME=jammy
2026-02-24T10:48:40.300 INFO:teuthology.provision.fog.trial054:Deploy complete!
2026-02-24T10:48:40.302 DEBUG:teuthology.parallel:result is None
2026-02-24T10:49:05.812 WARNING:teuthology.provision.fog.trial129:timed out
2026-02-24T10:49:11.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:49:11.886 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-24T10:49:11.886 DEBUG:teuthology.orchestra.run.trial129:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-24T10:49:12.284 INFO:teuthology.provision.fog.trial129:Node is ready
2026-02-24T10:49:12.284 DEBUG:teuthology.orchestra.run.trial129:> hostname
2026-02-24T10:49:12.331 INFO:teuthology.orchestra.run.trial129.stdout:trial129.front.sepia.ceph.com
2026-02-24T10:49:12.331 DEBUG:teuthology.orchestra.run.trial129:> grep trial129.front.sepia.ceph.com /etc/hosts
2026-02-24T10:49:12.376 INFO:teuthology.orchestra.run.trial129.stdout:10.20.193.129 trial129.front.sepia.ceph.com trial129
2026-02-24T10:49:12.376 DEBUG:teuthology.orchestra.run.trial129:> sudo hostname trial129
2026-02-24T10:49:12.430 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i -e 's/trial129.front.sepia.ceph.com/trial129/g' /etc/hosts
2026-02-24T10:49:12.480 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i -e 's/10.20.193.129/10.20.193.129/g' /etc/hosts
2026-02-24T10:49:12.532 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i -e 's/trial129.front.sepia.ceph.com/trial129/g' /etc/hostname
2026-02-24T10:49:12.584 DEBUG:teuthology.orchestra.run.trial129:> sudo hostname trial129
2026-02-24T10:49:12.635 DEBUG:teuthology.orchestra.run.trial129:> cat /etc/os-release
2026-02-24T10:49:12.680 INFO:teuthology.orchestra.run.trial129.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T10:49:12.680 INFO:teuthology.orchestra.run.trial129.stdout:NAME="Ubuntu"
2026-02-24T10:49:12.680 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_ID="22.04"
2026-02-24T10:49:12.680 INFO:teuthology.orchestra.run.trial129.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T10:49:12.680 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_CODENAME=jammy
2026-02-24T10:49:12.680 INFO:teuthology.orchestra.run.trial129.stdout:ID=ubuntu
2026-02-24T10:49:12.681 INFO:teuthology.orchestra.run.trial129.stdout:ID_LIKE=debian
2026-02-24T10:49:12.681 INFO:teuthology.orchestra.run.trial129.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T10:49:12.681 INFO:teuthology.orchestra.run.trial129.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T10:49:12.681 INFO:teuthology.orchestra.run.trial129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T10:49:12.681 INFO:teuthology.orchestra.run.trial129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T10:49:12.681 INFO:teuthology.orchestra.run.trial129.stdout:UBUNTU_CODENAME=jammy
2026-02-24T10:49:12.682 INFO:teuthology.provision.fog.trial129:Deploy complete!
2026-02-24T10:49:12.683 DEBUG:teuthology.parallel:result is None
2026-02-24T10:49:13.265 INFO:teuthology.lock.ops:Checking trial054.front.sepia.ceph.com
2026-02-24T10:49:13.265 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T10:49:13.379 INFO:teuthology.lock.ops:Checking trial129.front.sepia.ceph.com
2026-02-24T10:49:13.379 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-24T10:49:13.444 INFO:teuthology.lock.ops:Updating [trial054.front.sepia.ceph.com]: set os type and version on server
2026-02-24T10:49:13.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial054.front.sepia.ceph.com'
2026-02-24T10:49:13.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial054.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:49:13.512 DEBUG:teuthology.orchestra.run.trial054:> true
2026-02-24T10:49:13.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial054.front.sepia.ceph.com'
2026-02-24T10:49:13.647 DEBUG:teuthology.orchestra.run.trial054:> uname -m
2026-02-24T10:49:13.692 INFO:teuthology.orchestra.run.trial054.stdout:x86_64
2026-02-24T10:49:13.692 DEBUG:teuthology.orchestra.run.trial054:> cat /etc/os-release
2026-02-24T10:49:13.736 INFO:teuthology.orchestra.run.trial054.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:NAME="Ubuntu"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:VERSION_ID="22.04"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:VERSION_CODENAME=jammy
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:ID=ubuntu
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:ID_LIKE=debian
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T10:49:13.737 INFO:teuthology.orchestra.run.trial054.stdout:UBUNTU_CODENAME=jammy
2026-02-24T10:49:13.737 INFO:teuthology.lock.ops:Updating trial054.front.sepia.ceph.com on lock server
2026-02-24T10:49:13.835 INFO:teuthology.lock.ops:Updating [trial129.front.sepia.ceph.com]: set os type and version on server
2026-02-24T10:49:13.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial129.front.sepia.ceph.com'
2026-02-24T10:49:13.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-24T10:49:13.900 DEBUG:teuthology.orchestra.run.trial129:> true
2026-02-24T10:49:13.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial129.front.sepia.ceph.com'
2026-02-24T10:49:13.980 DEBUG:teuthology.orchestra.run.trial129:> uname -m
2026-02-24T10:49:14.027 INFO:teuthology.orchestra.run.trial129.stdout:x86_64
2026-02-24T10:49:14.027 DEBUG:teuthology.orchestra.run.trial129:> cat /etc/os-release
2026-02-24T10:49:14.071 INFO:teuthology.orchestra.run.trial129.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-24T10:49:14.071 INFO:teuthology.orchestra.run.trial129.stdout:NAME="Ubuntu"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_ID="22.04"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_CODENAME=jammy
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:ID=ubuntu
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:ID_LIKE=debian
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-24T10:49:14.072 INFO:teuthology.orchestra.run.trial129.stdout:UBUNTU_CODENAME=jammy
2026-02-24T10:49:14.073 INFO:teuthology.lock.ops:Updating trial129.front.sepia.ceph.com on lock server
2026-02-24T10:49:14.181 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:49:14.269 INFO:teuthology.dispatcher.supervisor:Running job 67455
2026-02-24T10:49:14.269 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_anuchaithra@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/anuchaithra-2026-02-24_05:45:14-rgw-wip-anrao3-testing-2026-02-23-1702-distro-default-trial/67455 --name anuchaithra-2026-02-24_05:45:14-rgw-wip-anrao3-testing-2026-02-23-1702-distro-default-trial --description rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off-no-gc} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{admin-pagination bucket-check cls mp_reupload rados-pool-quota ragweed reshard s3tests versioning zzz-s3tests-java} validater/valgrind} -- /home/teuthworker/mnt/teuthology/anuchaithra-2026-02-24_05:45:14-rgw-wip-anrao3-testing-2026-02-23-1702-distro-default-trial/67455/orig.config.yaml
2026-02-24T10:49:14.269 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/anuchaithra-2026-02-24_05:45:14-rgw-wip-anrao3-testing-2026-02-23-1702-distro-default-trial/67455
2026-02-24T10:49:14.269 INFO:teuthology.dispatcher.supervisor:Job PID: 4026213
2026-02-24T10:49:14.269 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-24T10:51:14.271 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:53:14.362 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:55:14.506 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:57:14.626 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T10:59:14.744 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:01:14.868 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:03:15.003 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:05:15.130 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:07:17.194 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:09:17.316 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:11:17.448 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:13:17.578 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:15:17.713 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:17:17.834 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:19:17.959 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:21:18.089 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:23:18.208 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:25:18.327 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:27:18.449 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:29:18.571 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:31:18.692 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:33:18.816 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:35:18.946 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:37:19.067 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:39:19.186 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:41:19.309 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:43:19.428 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:45:19.549 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:47:19.671 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:49:19.793 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:51:19.928 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:53:20.048 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:55:20.175 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:57:20.298 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-24T11:57:20.416 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-24T11:57:20.537 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-24T11:57:21.077 INFO:teuthology.orchestra.console.trial129:Power off
2026-02-24T11:57:21.077 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T11:57:21.089 INFO:teuthology.orchestra.console.trial054:Power off
2026-02-24T11:57:21.089 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-24T11:57:21.116 DEBUG:teuthology.orchestra.console.trial129:power off output: Chassis Power Control: Down/Off
2026-02-24T11:57:21.128 DEBUG:teuthology.orchestra.console.trial054:power off output: Chassis Power Control: Down/Off
2026-02-24T11:57:25.117 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:57:25.129 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:57:25.232 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is on
2026-02-24T11:57:25.239 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is on
2026-02-24T11:57:29.233 DEBUG:teuthology.orchestra.console.trial129:pexpect command: ipmitool -H trial129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:57:29.241 DEBUG:teuthology.orchestra.console.trial054:pexpect command: ipmitool -H trial054.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-24T11:57:29.344 DEBUG:teuthology.orchestra.console.trial129:check power output: Chassis Power is off
2026-02-24T11:57:29.344 INFO:teuthology.orchestra.console.trial129:Power off completed
2026-02-24T11:57:29.351 DEBUG:teuthology.orchestra.console.trial054:check power output: Chassis Power is off
2026-02-24T11:57:29.352 INFO:teuthology.orchestra.console.trial054:Power off completed
2026-02-24T11:57:29.545 INFO:teuthology.lock.ops:unlocked: trial129.front.sepia.ceph.com
2026-02-24T11:57:29.557 INFO:teuthology.lock.ops:unlocked: trial054.front.sepia.ceph.com