2026-02-13T18:59:08.276 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T18:59:08.277 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T18:59:08.348 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T18:59:08.539 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76317c027c40>, signals=[15]) 2026-02-13T18:59:08.539 INFO:teuthology.lock.ops:Start node 'trial086.front.sepia.ceph.com' reimaging 2026-02-13T18:59:08.539 INFO:teuthology.lock.ops:Updating [trial086.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T18:59:08.539 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-13T18:59:08.596 INFO:teuthology.lock.ops:Start node 'trial091.front.sepia.ceph.com' reimaging 2026-02-13T18:59:08.596 INFO:teuthology.lock.ops:Updating [trial091.front.sepia.ceph.com]: reset os type and version on server 2026-02-13T18:59:08.596 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server 2026-02-13T18:59:08.825 DEBUG:teuthology.provision.fog.trial086:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T18:59:08.835 DEBUG:teuthology.provision.fog.trial091:Requesting image trial_centos_9.stream (ID 3) 2026-02-13T18:59:08.878 INFO:teuthology.provision.fog.trial086:Scheduling deploy of centos 9.stream 2026-02-13T18:59:08.887 INFO:teuthology.provision.fog.trial091:Scheduling deploy of centos 9.stream 2026-02-13T18:59:09.976 INFO:teuthology.orchestra.console.trial086:Power off 2026-02-13T18:59:09.977 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T18:59:09.987 INFO:teuthology.orchestra.console.trial091:Power off 2026-02-13T18:59:09.987 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T18:59:10.017 DEBUG:teuthology.orchestra.console.trial086:power off output: Chassis Power Control: Down/Off 2026-02-13T18:59:10.023 DEBUG:teuthology.orchestra.console.trial091:power off output: Chassis Power Control: Down/Off 2026-02-13T18:59:14.021 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:59:14.028 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:59:14.130 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is off 2026-02-13T18:59:14.131 INFO:teuthology.orchestra.console.trial086:Power off completed 2026-02-13T18:59:14.136 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is off 2026-02-13T18:59:14.136 INFO:teuthology.orchestra.console.trial091:Power off completed 2026-02-13T18:59:14.232 INFO:teuthology.orchestra.console.trial086:Power on 2026-02-13T18:59:14.232 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T18:59:14.240 INFO:teuthology.orchestra.console.trial091:Power on 2026-02-13T18:59:14.241 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-13T18:59:14.271 DEBUG:teuthology.orchestra.console.trial086:power on output: Chassis Power Control: Up/On 2026-02-13T18:59:14.278 DEBUG:teuthology.orchestra.console.trial091:power on output: Chassis Power Control: Up/On 2026-02-13T18:59:18.277 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:59:18.284 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T18:59:18.387 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is on 2026-02-13T18:59:18.387 INFO:teuthology.orchestra.console.trial086:Power on completed 2026-02-13T18:59:18.393 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is on 2026-02-13T18:59:18.394 INFO:teuthology.orchestra.console.trial091:Power on completed 2026-02-13T18:59:18.488 INFO:teuthology.provision.fog.trial086:Waiting for deploy to finish 2026-02-13T18:59:18.494 INFO:teuthology.provision.fog.trial091:Waiting for deploy to finish 2026-02-13T19:01:05.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:20.157 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91 2026-02-13T19:01:21.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:26.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:29.245 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91 2026-02-13T19:01:35.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:35.453 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-13T19:01:38.333 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91 2026-02-13T19:01:41.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:44.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:44.541 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-13T19:01:47.421 WARNING:teuthology.provision.fog.trial091:[Errno None] Unable to connect to port 22 on 10.20.193.91 2026-02-13T19:01:50.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:53.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:01:53.630 WARNING:teuthology.provision.fog.trial086:[Errno None] Unable to connect to port 22 on 10.20.193.86 2026-02-13T19:01:59.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:02:29.368 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T19:02:29.369 DEBUG:teuthology.orchestra.run.trial091:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T19:02:29.523 INFO:teuthology.provision.fog.trial091:Node is ready 2026-02-13T19:02:29.523 DEBUG:teuthology.orchestra.run.trial091:> hostname 2026-02-13T19:02:29.578 INFO:teuthology.orchestra.run.trial091.stdout:trial091.front.sepia.ceph.com 2026-02-13T19:02:29.578 DEBUG:teuthology.orchestra.run.trial091:> grep trial091.front.sepia.ceph.com /etc/hosts 2026-02-13T19:02:29.635 INFO:teuthology.orchestra.run.trial091.stdout:10.20.193.91 trial091.front.sepia.ceph.com trial091 2026-02-13T19:02:29.635 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname trial091 2026-02-13T19:02:29.703 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/trial091.front.sepia.ceph.com/trial091/g' /etc/hosts 2026-02-13T19:02:29.767 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/10.20.193.91/10.20.193.91/g' /etc/hosts 2026-02-13T19:02:29.831 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i -e 's/trial091.front.sepia.ceph.com/trial091/g' /etc/hostname 2026-02-13T19:02:29.897 DEBUG:teuthology.orchestra.run.trial091:> sudo hostname trial091 2026-02-13T19:02:29.960 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release 2026-02-13T19:02:30.017 INFO:teuthology.orchestra.run.trial091.stdout:NAME="CentOS Stream" 2026-02-13T19:02:30.017 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="9" 2026-02-13T19:02:30.017 INFO:teuthology.orchestra.run.trial091.stdout:ID="centos" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel fedora" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="9" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el9" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;31" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://centos.org/" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T19:02:30.018 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T19:02:30.020 INFO:teuthology.provision.fog.trial091:Deploy complete! 2026-02-13T19:02:30.021 DEBUG:teuthology.parallel:result is None 2026-02-13T19:02:35.510 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-13T19:02:35.510 DEBUG:teuthology.orchestra.run.trial086:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-13T19:02:35.663 INFO:teuthology.provision.fog.trial086:Node is ready 2026-02-13T19:02:35.663 DEBUG:teuthology.orchestra.run.trial086:> hostname 2026-02-13T19:02:35.718 INFO:teuthology.orchestra.run.trial086.stdout:trial086.front.sepia.ceph.com 2026-02-13T19:02:35.718 DEBUG:teuthology.orchestra.run.trial086:> grep trial086.front.sepia.ceph.com /etc/hosts 2026-02-13T19:02:35.774 INFO:teuthology.orchestra.run.trial086.stdout:10.20.193.86 trial086.front.sepia.ceph.com trial086 2026-02-13T19:02:35.774 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname trial086 2026-02-13T19:02:35.842 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/trial086.front.sepia.ceph.com/trial086/g' /etc/hosts 2026-02-13T19:02:35.907 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/10.20.193.86/10.20.193.86/g' /etc/hosts 2026-02-13T19:02:35.972 DEBUG:teuthology.orchestra.run.trial086:> sudo sed -i -e 's/trial086.front.sepia.ceph.com/trial086/g' /etc/hostname 2026-02-13T19:02:36.035 DEBUG:teuthology.orchestra.run.trial086:> sudo hostname trial086 2026-02-13T19:02:36.099 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-13T19:02:36.155 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-13T19:02:36.156 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T19:02:36.157 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-13T19:02:36.157 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T19:02:36.157 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T19:02:36.157 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T19:02:36.157 INFO:teuthology.provision.fog.trial086:Deploy complete! 2026-02-13T19:02:36.158 DEBUG:teuthology.parallel:result is None 2026-02-13T19:02:36.560 INFO:teuthology.lock.ops:Checking trial086.front.sepia.ceph.com 2026-02-13T19:02:36.560 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T19:02:36.649 INFO:teuthology.lock.ops:Checking trial091.front.sepia.ceph.com 2026-02-13T19:02:36.649 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-13T19:02:36.715 INFO:teuthology.lock.ops:Updating [trial086.front.sepia.ceph.com]: set os type and version on server 2026-02-13T19:02:36.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-13T19:02:36.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:02:36.778 DEBUG:teuthology.orchestra.run.trial086:> true 2026-02-13T19:02:36.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial086.front.sepia.ceph.com' 2026-02-13T19:02:36.858 DEBUG:teuthology.orchestra.run.trial086:> uname -m 2026-02-13T19:02:36.914 INFO:teuthology.orchestra.run.trial086.stdout:x86_64 2026-02-13T19:02:36.915 DEBUG:teuthology.orchestra.run.trial086:> cat /etc/os-release 2026-02-13T19:02:36.970 INFO:teuthology.orchestra.run.trial086.stdout:NAME="CentOS Stream" 2026-02-13T19:02:36.970 INFO:teuthology.orchestra.run.trial086.stdout:VERSION="9" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:ID="centos" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:ID_LIKE="rhel fedora" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:VERSION_ID="9" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:PLATFORM_ID="platform:el9" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:ANSI_COLOR="0;31" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:LOGO="fedora-logo-icon" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:HOME_URL="https://centos.org/" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T19:02:36.971 INFO:teuthology.orchestra.run.trial086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T19:02:36.972 INFO:teuthology.lock.ops:Updating trial086.front.sepia.ceph.com on lock server 2026-02-13T19:02:37.075 INFO:teuthology.lock.ops:Updating [trial091.front.sepia.ceph.com]: set os type and version on server 2026-02-13T19:02:37.075 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T19:02:37.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T19:02:37.145 DEBUG:teuthology.orchestra.run.trial091:> true 2026-02-13T19:02:37.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-13T19:02:37.216 DEBUG:teuthology.orchestra.run.trial091:> uname -m 2026-02-13T19:02:37.271 INFO:teuthology.orchestra.run.trial091.stdout:x86_64 2026-02-13T19:02:37.272 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:NAME="CentOS Stream" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="9" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:ID="centos" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel fedora" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="9" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el9" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T19:02:37.328 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;31" 2026-02-13T19:02:37.329 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon" 2026-02-13T19:02:37.329 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T19:02:37.329 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://centos.org/" 2026-02-13T19:02:37.329 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T19:02:37.329 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T19:02:37.329 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T19:02:37.330 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server 2026-02-13T19:02:37.438 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:02:37.530 INFO:teuthology.dispatcher.supervisor:Running job 49775 2026-02-13T19:02:37.530 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49775 --name yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial --description rados/cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rmdir-reactivate} -- /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49775/orig.config.yaml 2026-02-13T19:02:37.530 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/49775 2026-02-13T19:02:37.530 INFO:teuthology.dispatcher.supervisor:Job PID: 3350880 2026-02-13T19:02:37.530 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-13T19:04:37.536 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:06:37.647 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:08:37.781 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:10:37.995 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:11:08.077 ERROR:teuthology.report:POST to https://paddles-paddles.apps.pok.os.sepia.ceph.com/runs/yuriw-2026-02-13_16:37:03-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/jobs/ failed with status 504:

504 Gateway Time-out

The server didn't respond in time. 2026-02-13T19:11:19.661 ERROR:teuthology.report:Could not report results to https://paddles-paddles.apps.pok.os.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 715, in urlopen httplib_response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 467, in _make_request six.raise_from(e, None) File "", line 3, in raise_from File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 462, in _make_request httplib_response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 1448, in getresponse response.begin() File "/usr/lib/python3.12/http/client.py", line 336, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 305, in _read_status raise RemoteDisconnected("Remote end closed connection without" http.client.RemoteDisconnected: Remote end closed connection without response During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/requests/adapters.py", line 486, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 799, in urlopen retries = retries.increment( ^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/util/retry.py", line 550, in increment raise six.reraise(type(error), error, _stacktrace) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/packages/six.py", line 769, in reraise raise value.with_traceback(tb) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 715, in urlopen httplib_response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 467, in _make_request six.raise_from(e, None) File "", line 3, in raise_from File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/urllib3/connectionpool.py", line 462, in _make_request httplib_response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 1448, in getresponse response.begin() File "/usr/lib/python3.12/http/client.py", line 336, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/http/client.py", line 305, in _read_status raise RemoteDisconnected("Remote end closed connection without" urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/report.py", line 515, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/report.py", line 474, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/report.py", line 300, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/requests/sessions.py", line 637, in post return self.request("POST", url, data=data, json=json, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/virtualenv/lib/python3.12/site-packages/requests/adapters.py", line 501, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) 2026-02-13T19:13:19.765 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T19:13:19.878 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-13T19:13:19.999 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-13T19:13:20.569 INFO:teuthology.orchestra.console.trial086:Power off 2026-02-13T19:13:20.569 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T19:13:20.588 INFO:teuthology.orchestra.console.trial091:Power off 2026-02-13T19:13:20.588 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-13T19:13:20.608 DEBUG:teuthology.orchestra.console.trial086:power off output: Chassis Power Control: Down/Off 2026-02-13T19:13:20.626 DEBUG:teuthology.orchestra.console.trial091:power off output: Chassis Power Control: Down/Off 2026-02-13T19:13:24.613 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:24.627 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:24.723 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is on 2026-02-13T19:13:24.735 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is on 2026-02-13T19:13:28.728 DEBUG:teuthology.orchestra.console.trial086:pexpect command: ipmitool -H trial086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:28.738 DEBUG:teuthology.orchestra.console.trial091:pexpect command: ipmitool -H trial091.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-13T19:13:28.840 DEBUG:teuthology.orchestra.console.trial086:check power output: Chassis Power is off 2026-02-13T19:13:28.840 INFO:teuthology.orchestra.console.trial086:Power off completed 2026-02-13T19:13:28.847 DEBUG:teuthology.orchestra.console.trial091:check power output: Chassis Power is off 2026-02-13T19:13:28.847 INFO:teuthology.orchestra.console.trial091:Power off completed 2026-02-13T19:13:29.086 INFO:teuthology.lock.ops:unlocked: trial086.front.sepia.ceph.com 2026-02-13T19:13:29.098 INFO:teuthology.lock.ops:unlocked: trial091.front.sepia.ceph.com