2026-02-21T23:12:12.202 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-21T23:12:12.202 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:12:12.274 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:12:12.420 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7835bb0763c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7835ba493560>, signals=[15])
2026-02-21T23:12:12.420 INFO:teuthology.lock.ops:Start node 'trial183.front.sepia.ceph.com' reimaging
2026-02-21T23:12:12.421 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: reset os type and version on server
2026-02-21T23:12:12.421 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server
2026-02-21T23:12:12.592 DEBUG:teuthology.provision.fog.trial183:Requesting image trial_ubuntu_22.04 (ID 1)
2026-02-21T23:12:12.649 INFO:teuthology.provision.fog.trial183:Scheduling deploy of ubuntu 22.04
2026-02-21T23:12:13.929 INFO:teuthology.orchestra.console.trial183:Power off
2026-02-21T23:12:13.929 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-21T23:12:13.968 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off
2026-02-21T23:12:17.972 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-21T23:12:18.083 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off
2026-02-21T23:12:18.083 INFO:teuthology.orchestra.console.trial183:Power off completed
2026-02-21T23:12:18.184 INFO:teuthology.orchestra.console.trial183:Power on
2026-02-21T23:12:18.184 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-21T23:12:18.225 DEBUG:teuthology.orchestra.console.trial183:power on output: Chassis Power Control: Up/On
2026-02-21T23:12:22.229 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-21T23:12:22.340 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on
2026-02-21T23:12:22.340 INFO:teuthology.orchestra.console.trial183:Power on completed
2026-02-21T23:12:22.441 INFO:teuthology.provision.fog.trial183:Waiting for deploy to finish
2026-02-21T23:14:25.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-21T23:14:28.929 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-21T23:14:34.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-21T23:14:38.016 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-21T23:14:44.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-21T23:14:47.105 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-21T23:14:53.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-21T23:14:56.191 WARNING:teuthology.provision.fog.trial183:[Errno None] Unable to connect to port 22 on 10.20.193.183
2026-02-21T23:15:02.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-21T23:15:38.105 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-21T23:15:38.105 DEBUG:teuthology.orchestra.run.trial183:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-21T23:15:38.489 INFO:teuthology.provision.fog.trial183:Node is ready
2026-02-21T23:15:38.489 DEBUG:teuthology.orchestra.run.trial183:> hostname
2026-02-21T23:15:38.537 INFO:teuthology.orchestra.run.trial183.stdout:trial183.front.sepia.ceph.com
2026-02-21T23:15:38.537 DEBUG:teuthology.orchestra.run.trial183:> grep trial183.front.sepia.ceph.com /etc/hosts
2026-02-21T23:15:38.584 INFO:teuthology.orchestra.run.trial183.stdout:10.20.193.183 trial183.front.sepia.ceph.com trial183
2026-02-21T23:15:38.584 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183
2026-02-21T23:15:38.635 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hosts
2026-02-21T23:15:38.684 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/10.20.193.183/10.20.193.183/g' /etc/hosts
2026-02-21T23:15:38.735 DEBUG:teuthology.orchestra.run.trial183:> sudo sed -i -e 's/trial183.front.sepia.ceph.com/trial183/g' /etc/hostname
2026-02-21T23:15:38.785 DEBUG:teuthology.orchestra.run.trial183:> sudo hostname trial183
2026-02-21T23:15:38.835 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release
2026-02-21T23:15:38.881 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-21T23:15:38.881 INFO:teuthology.orchestra.run.trial183.stdout:NAME="Ubuntu"
2026-02-21T23:15:38.882 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="22.04"
2026-02-21T23:15:38.882 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-21T23:15:38.882 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_CODENAME=jammy
2026-02-21T23:15:38.882 INFO:teuthology.orchestra.run.trial183.stdout:ID=ubuntu
2026-02-21T23:15:38.882 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE=debian
2026-02-21T23:15:38.883 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-21T23:15:38.883 INFO:teuthology.orchestra.run.trial183.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-21T23:15:38.883 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-21T23:15:38.883 INFO:teuthology.orchestra.run.trial183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-21T23:15:38.883 INFO:teuthology.orchestra.run.trial183.stdout:UBUNTU_CODENAME=jammy
2026-02-21T23:15:38.885 INFO:teuthology.provision.fog.trial183:Deploy complete!
2026-02-21T23:15:38.886 DEBUG:teuthology.parallel:result is None
2026-02-21T23:15:39.223 INFO:teuthology.lock.ops:Checking trial183.front.sepia.ceph.com
2026-02-21T23:15:39.223 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-21T23:15:39.302 INFO:teuthology.lock.ops:Updating [trial183.front.sepia.ceph.com]: set os type and version on server
2026-02-21T23:15:39.303 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial183.front.sepia.ceph.com'
2026-02-21T23:15:39.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-21T23:15:39.368 DEBUG:teuthology.orchestra.run.trial183:> true
2026-02-21T23:15:39.447 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial183.front.sepia.ceph.com'
2026-02-21T23:15:39.447 DEBUG:teuthology.orchestra.run.trial183:> uname -m
2026-02-21T23:15:39.492 INFO:teuthology.orchestra.run.trial183.stdout:x86_64
2026-02-21T23:15:39.492 DEBUG:teuthology.orchestra.run.trial183:> cat /etc/os-release
2026-02-21T23:15:39.536 INFO:teuthology.orchestra.run.trial183.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS"
2026-02-21T23:15:39.536 INFO:teuthology.orchestra.run.trial183.stdout:NAME="Ubuntu"
2026-02-21T23:15:39.536 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_ID="22.04"
2026-02-21T23:15:39.536 INFO:teuthology.orchestra.run.trial183.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)"
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:VERSION_CODENAME=jammy
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:ID=ubuntu
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:ID_LIKE=debian
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:HOME_URL="https://www.ubuntu.com/"
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2026-02-21T23:15:39.537 INFO:teuthology.orchestra.run.trial183.stdout:UBUNTU_CODENAME=jammy
2026-02-21T23:15:39.538 INFO:teuthology.lock.ops:Updating trial183.front.sepia.ceph.com on lock server
2026-02-21T23:15:39.638 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:15:39.730 INFO:teuthology.dispatcher.supervisor:Running job 63304
2026-02-21T23:15:39.730 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_nmordech@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63304 --name nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial --description rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63304/orig.config.yaml
2026-02-21T23:15:39.730 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/nmordech-2026-02-21_21:55:34-rados-wip-rocky10-branch-of-the-day-2026-02-21-1771692874-tentacle-distro-default-trial/63304
2026-02-21T23:15:39.730 INFO:teuthology.dispatcher.supervisor:Job PID: 1632303
2026-02-21T23:15:39.730 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-21T23:17:39.776 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:19:39.870 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:21:40.082 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:23:40.235 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:25:40.425 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:27:42.644 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:29:42.858 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:31:43.051 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-21T23:31:43.136 INFO:teuthology.dispatcher.supervisor:Success!
2026-02-21T23:31:43.195 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-21T23:31:43.487 INFO:teuthology.orchestra.console.trial183:Power off
2026-02-21T23:31:43.487 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-21T23:31:43.524 DEBUG:teuthology.orchestra.console.trial183:power off output: Chassis Power Control: Down/Off
2026-02-21T23:31:47.529 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-21T23:31:47.637 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is on
2026-02-21T23:31:51.642 DEBUG:teuthology.orchestra.console.trial183:pexpect command: ipmitool -H trial183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-21T23:31:51.751 DEBUG:teuthology.orchestra.console.trial183:check power output: Chassis Power is off
2026-02-21T23:31:51.751 INFO:teuthology.orchestra.console.trial183:Power off completed
2026-02-21T23:31:51.962 INFO:teuthology.lock.ops:unlocked: trial183.front.sepia.ceph.com