2026-02-21T22:48:05.467 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-21T22:48:05.468 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:48:05.540 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:48:05.675 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7836f0871620>, signals=[15]) 2026-02-21T22:48:05.675 INFO:teuthology.lock.ops:Start node 'trial168.front.sepia.ceph.com' reimaging 2026-02-21T22:48:05.675 INFO:teuthology.lock.ops:Updating [trial168.front.sepia.ceph.com]: reset os type and version on server 2026-02-21T22:48:05.675 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server 2026-02-21T22:48:05.853 DEBUG:teuthology.provision.fog.trial168:Requesting image trial_ubuntu_22.04 (ID 1) 2026-02-21T22:48:05.871 INFO:teuthology.provision.fog.trial168:Scheduling deploy of ubuntu 22.04 2026-02-21T22:48:07.474 INFO:teuthology.orchestra.console.trial168:Power off 2026-02-21T22:48:07.474 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:48:07.512 DEBUG:teuthology.orchestra.console.trial168:power off output: Chassis Power Control: Down/Off 2026-02-21T22:48:11.517 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:48:11.626 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is off 2026-02-21T22:48:11.626 INFO:teuthology.orchestra.console.trial168:Power off completed 2026-02-21T22:48:11.727 INFO:teuthology.orchestra.console.trial168:Power on 2026-02-21T22:48:11.727 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2026-02-21T22:48:11.767 DEBUG:teuthology.orchestra.console.trial168:power on output: Chassis Power Control: Up/On 2026-02-21T22:48:15.772 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:48:15.880 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is on 2026-02-21T22:48:15.881 INFO:teuthology.orchestra.console.trial168:Power on completed 2026-02-21T22:48:15.981 INFO:teuthology.provision.fog.trial168:Waiting for deploy to finish 2026-02-21T22:50:19.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:50:22.080 WARNING:teuthology.provision.fog.trial168:[Errno None] Unable to connect to port 22 on 10.20.193.168 2026-02-21T22:50:28.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:50:31.168 WARNING:teuthology.provision.fog.trial168:[Errno None] Unable to connect to port 22 on 10.20.193.168 2026-02-21T22:50:37.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:50:40.256 WARNING:teuthology.provision.fog.trial168:[Errno None] Unable to connect to port 22 on 10.20.193.168 2026-02-21T22:50:46.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:50:49.344 WARNING:teuthology.provision.fog.trial168:[Errno None] Unable to connect to port 22 on 10.20.193.168 2026-02-21T22:50:55.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:51:31.156 INFO:teuthology.orchestra.run:Running command with timeout 600 2026-02-21T22:51:31.156 DEBUG:teuthology.orchestra.run.trial168:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done 2026-02-21T22:51:31.546 INFO:teuthology.provision.fog.trial168:Node is ready 2026-02-21T22:51:31.547 DEBUG:teuthology.orchestra.run.trial168:> hostname 2026-02-21T22:51:31.597 INFO:teuthology.orchestra.run.trial168.stdout:trial168.front.sepia.ceph.com 2026-02-21T22:51:31.598 DEBUG:teuthology.orchestra.run.trial168:> grep trial168.front.sepia.ceph.com /etc/hosts 2026-02-21T22:51:31.641 INFO:teuthology.orchestra.run.trial168.stdout:10.20.193.168 trial168.front.sepia.ceph.com trial168 2026-02-21T22:51:31.642 DEBUG:teuthology.orchestra.run.trial168:> sudo hostname trial168 2026-02-21T22:51:31.697 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/trial168.front.sepia.ceph.com/trial168/g' /etc/hosts 2026-02-21T22:51:31.750 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/10.20.193.168/10.20.193.168/g' /etc/hosts 2026-02-21T22:51:31.806 DEBUG:teuthology.orchestra.run.trial168:> sudo sed -i -e 's/trial168.front.sepia.ceph.com/trial168/g' /etc/hostname 2026-02-21T22:51:31.859 DEBUG:teuthology.orchestra.run.trial168:> sudo hostname trial168 2026-02-21T22:51:31.914 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release 2026-02-21T22:51:31.962 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:51:31.962 INFO:teuthology.orchestra.run.trial168.stdout:NAME="Ubuntu" 2026-02-21T22:51:31.962 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="22.04" 2026-02-21T22:51:31.962 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_CODENAME=jammy 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:ID=ubuntu 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE=debian 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:51:31.963 INFO:teuthology.orchestra.run.trial168.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:51:31.964 INFO:teuthology.provision.fog.trial168:Deploy complete! 2026-02-21T22:51:31.965 DEBUG:teuthology.parallel:result is None 2026-02-21T22:51:32.306 INFO:teuthology.lock.ops:Checking trial168.front.sepia.ceph.com 2026-02-21T22:51:32.307 INFO:teuthology.lock.ops:New key found. Updating... 2026-02-21T22:51:32.380 INFO:teuthology.lock.ops:Updating [trial168.front.sepia.ceph.com]: set os type and version on server 2026-02-21T22:51:32.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-21T22:51:32.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial168.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-21T22:51:32.444 DEBUG:teuthology.orchestra.run.trial168:> true 2026-02-21T22:51:32.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial168.front.sepia.ceph.com' 2026-02-21T22:51:32.521 DEBUG:teuthology.orchestra.run.trial168:> uname -m 2026-02-21T22:51:32.565 INFO:teuthology.orchestra.run.trial168.stdout:x86_64 2026-02-21T22:51:32.566 DEBUG:teuthology.orchestra.run.trial168:> cat /etc/os-release 2026-02-21T22:51:32.610 INFO:teuthology.orchestra.run.trial168.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-21T22:51:32.610 INFO:teuthology.orchestra.run.trial168.stdout:NAME="Ubuntu" 2026-02-21T22:51:32.610 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_ID="22.04" 2026-02-21T22:51:32.610 INFO:teuthology.orchestra.run.trial168.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-21T22:51:32.610 INFO:teuthology.orchestra.run.trial168.stdout:VERSION_CODENAME=jammy 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:ID=ubuntu 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:ID_LIKE=debian 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-21T22:51:32.611 INFO:teuthology.orchestra.run.trial168.stdout:UBUNTU_CODENAME=jammy 2026-02-21T22:51:32.612 INFO:teuthology.lock.ops:Updating trial168.front.sepia.ceph.com on lock server 2026-02-21T22:51:32.705 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:51:32.792 INFO:teuthology.dispatcher.supervisor:Running job 63226 2026-02-21T22:51:32.792 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63226 --name nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial --description rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/none msgr/async objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-1} onode-segment$/{256K} write$/{random/{compr$/{yes$/{zlib}} random}}}} rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63226/orig.config.yaml 2026-02-21T22:51:32.793 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63226 2026-02-21T22:51:32.793 INFO:teuthology.dispatcher.supervisor:Job PID: 1398335 2026-02-21T22:51:32.793 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2026-02-21T22:53:32.893 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:55:33.013 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:57:33.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:59:33.388 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-21T22:59:33.467 INFO:teuthology.dispatcher.supervisor:Success! 2026-02-21T22:59:33.528 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2026-02-21T22:59:33.832 INFO:teuthology.orchestra.console.trial168:Power off 2026-02-21T22:59:33.832 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2026-02-21T22:59:33.871 DEBUG:teuthology.orchestra.console.trial168:power off output: Chassis Power Control: Down/Off 2026-02-21T22:59:37.874 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:37.982 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is on 2026-02-21T22:59:41.986 DEBUG:teuthology.orchestra.console.trial168:pexpect command: ipmitool -H trial168.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2026-02-21T22:59:42.094 DEBUG:teuthology.orchestra.console.trial168:check power output: Chassis Power is off 2026-02-21T22:59:42.095 INFO:teuthology.orchestra.console.trial168:Power off completed 2026-02-21T22:59:42.255 INFO:teuthology.lock.ops:unlocked: trial168.front.sepia.ceph.com