2026-02-20T14:20:29.357 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0
2026-02-20T14:20:29.357 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:20:29.429 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:20:31.266 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x700f17b75190>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x700f1738a340>, signals=[15])
2026-02-20T14:20:31.267 INFO:teuthology.lock.ops:Start node 'trial060.front.sepia.ceph.com' reimaging
2026-02-20T14:20:31.267 INFO:teuthology.lock.ops:Updating [trial060.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T14:20:31.267 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server
2026-02-20T14:20:31.325 INFO:teuthology.lock.ops:Start node 'trial104.front.sepia.ceph.com' reimaging
2026-02-20T14:20:31.325 INFO:teuthology.lock.ops:Updating [trial104.front.sepia.ceph.com]: reset os type and version on server
2026-02-20T14:20:31.325 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server
2026-02-20T14:20:31.553 DEBUG:teuthology.provision.fog.trial060:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T14:20:31.603 INFO:teuthology.provision.fog.trial060:Scheduling deploy of centos 9.stream
2026-02-20T14:20:32.959 INFO:teuthology.orchestra.console.trial060:Power off
2026-02-20T14:20:32.959 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T14:20:32.998 DEBUG:teuthology.orchestra.console.trial060:power off output: Chassis Power Control: Down/Off
2026-02-20T14:20:34.636 DEBUG:teuthology.provision.fog.trial104:Requesting image trial_centos_9.stream (ID 3)
2026-02-20T14:20:34.687 INFO:teuthology.provision.fog.trial104:Scheduling deploy of centos 9.stream
2026-02-20T14:20:35.863 INFO:teuthology.orchestra.console.trial104:Power off
2026-02-20T14:20:35.863 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T14:20:35.901 DEBUG:teuthology.orchestra.console.trial104:power off output: Chassis Power Control: Down/Off
2026-02-20T14:20:37.000 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T14:20:37.109 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-20T14:20:37.110 INFO:teuthology.orchestra.console.trial060:Power off completed
2026-02-20T14:20:37.210 INFO:teuthology.orchestra.console.trial060:Power on
2026-02-20T14:20:37.210 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T14:20:37.249 DEBUG:teuthology.orchestra.console.trial060:power on output: Chassis Power Control: Up/On
2026-02-20T14:20:39.904 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T14:20:40.015 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is off
2026-02-20T14:20:40.016 INFO:teuthology.orchestra.console.trial104:Power off completed
2026-02-20T14:20:40.116 INFO:teuthology.orchestra.console.trial104:Power on
2026-02-20T14:20:40.117 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2026-02-20T14:20:40.157 DEBUG:teuthology.orchestra.console.trial104:power on output: Chassis Power Control: Up/On
2026-02-20T14:20:41.251 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T14:20:41.362 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-20T14:20:44.159 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T14:20:44.269 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is on
2026-02-20T14:20:44.270 INFO:teuthology.orchestra.console.trial104:Power on completed
2026-02-20T14:20:44.370 INFO:teuthology.provision.fog.trial104:Waiting for deploy to finish
2026-02-20T14:20:45.364 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T14:20:45.476 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is on
2026-02-20T14:20:45.476 INFO:teuthology.orchestra.console.trial060:Power on completed
2026-02-20T14:20:45.576 INFO:teuthology.provision.fog.trial060:Waiting for deploy to finish
2026-02-20T14:22:31.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:22:33.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:22:36.544 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-20T14:22:42.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:22:45.632 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-20T14:22:51.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:22:54.720 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-20T14:23:00.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:23:03.809 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-20T14:23:09.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:23:12.896 WARNING:teuthology.provision.fog.trial060:[Errno None] Unable to connect to port 22 on 10.20.193.60
2026-02-20T14:23:18.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:23:32.000 WARNING:teuthology.provision.fog.trial104:timed out
2026-02-20T14:23:38.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:23:45.360 ERROR:teuthology.orchestra.connection:Error authenticating with trial104.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/connection.py", line 111, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 485, in connect
    self._auth(
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 818, in _auth
    raise saved_exception
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/client.py", line 794, in _auth
    self._transport.auth_publickey(username, key)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/lib/python3.12/site-packages/paramiko/transport.py", line 1664, in auth_publickey
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2026-02-20T14:23:49.524 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T14:23:49.525 DEBUG:teuthology.orchestra.run.trial104:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T14:23:54.848 INFO:teuthology.provision.fog.trial104:Node is ready
2026-02-20T14:23:54.848 DEBUG:teuthology.orchestra.run.trial104:> hostname
2026-02-20T14:23:54.868 INFO:teuthology.orchestra.run:Running command with timeout 600
2026-02-20T14:23:54.868 DEBUG:teuthology.orchestra.run.trial060:> while [ ! -e '/.cephlab_hostname_set' ]; do sleep 5; done
2026-02-20T14:23:54.902 INFO:teuthology.orchestra.run.trial104.stdout:trial104.front.sepia.ceph.com
2026-02-20T14:23:54.902 DEBUG:teuthology.orchestra.run.trial104:> grep trial104.front.sepia.ceph.com /etc/hosts
2026-02-20T14:23:54.917 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104 trial104.front.sepia.ceph.com trial104
2026-02-20T14:23:54.917 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname trial104
2026-02-20T14:23:54.990 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/trial104.front.sepia.ceph.com/trial104/g' /etc/hosts
2026-02-20T14:23:55.027 INFO:teuthology.provision.fog.trial060:Node is ready
2026-02-20T14:23:55.027 DEBUG:teuthology.orchestra.run.trial060:> hostname
2026-02-20T14:23:55.056 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/10.20.193.104/10.20.193.104/g' /etc/hosts
2026-02-20T14:23:55.083 INFO:teuthology.orchestra.run.trial060.stdout:trial060.front.sepia.ceph.com
2026-02-20T14:23:55.084 DEBUG:teuthology.orchestra.run.trial060:> grep trial060.front.sepia.ceph.com /etc/hosts
2026-02-20T14:23:55.123 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i -e 's/trial104.front.sepia.ceph.com/trial104/g' /etc/hostname
2026-02-20T14:23:55.140 INFO:teuthology.orchestra.run.trial060.stdout:10.20.193.60 trial060.front.sepia.ceph.com trial060
2026-02-20T14:23:55.140 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname trial060
2026-02-20T14:23:55.188 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname trial104
2026-02-20T14:23:55.209 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/trial060.front.sepia.ceph.com/trial060/g' /etc/hosts
2026-02-20T14:23:55.254 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release
2026-02-20T14:23:55.273 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/10.20.193.60/10.20.193.60/g' /etc/hosts
2026-02-20T14:23:55.310 INFO:teuthology.orchestra.run.trial104.stdout:NAME="CentOS Stream"
2026-02-20T14:23:55.310 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="9"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:ID="centos"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel fedora"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="9"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el9"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;31"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://centos.org/"
2026-02-20T14:23:55.311 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T14:23:55.312 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T14:23:55.312 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T14:23:55.313 INFO:teuthology.provision.fog.trial104:Deploy complete!
2026-02-20T14:23:55.314 DEBUG:teuthology.parallel:result is None
2026-02-20T14:23:55.338 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i -e 's/trial060.front.sepia.ceph.com/trial060/g' /etc/hostname
2026-02-20T14:23:55.403 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname trial060
2026-02-20T14:23:55.466 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release
2026-02-20T14:23:55.522 INFO:teuthology.orchestra.run.trial060.stdout:NAME="CentOS Stream"
2026-02-20T14:23:55.522 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="9"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:ID="centos"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel fedora"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="9"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el9"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;31"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T14:23:55.523 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://centos.org/"
2026-02-20T14:23:55.524 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T14:23:55.524 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T14:23:55.524 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T14:23:55.524 INFO:teuthology.provision.fog.trial060:Deploy complete!
2026-02-20T14:23:55.525 DEBUG:teuthology.parallel:result is None
2026-02-20T14:23:55.923 INFO:teuthology.lock.ops:Checking trial060.front.sepia.ceph.com
2026-02-20T14:23:55.923 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T14:23:55.995 INFO:teuthology.lock.ops:Checking trial104.front.sepia.ceph.com
2026-02-20T14:23:55.995 INFO:teuthology.lock.ops:New key found. Updating...
2026-02-20T14:23:56.053 INFO:teuthology.lock.ops:Updating [trial060.front.sepia.ceph.com]: set os type and version on server
2026-02-20T14:23:56.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com'
2026-02-20T14:23:56.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:23:56.114 DEBUG:teuthology.orchestra.run.trial060:> true
2026-02-20T14:23:56.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial060.front.sepia.ceph.com'
2026-02-20T14:23:56.193 DEBUG:teuthology.orchestra.run.trial060:> uname -m
2026-02-20T14:23:56.250 INFO:teuthology.orchestra.run.trial060.stdout:x86_64
2026-02-20T14:23:56.250 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release
2026-02-20T14:23:56.308 INFO:teuthology.orchestra.run.trial060.stdout:NAME="CentOS Stream"
2026-02-20T14:23:56.308 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="9"
2026-02-20T14:23:56.308 INFO:teuthology.orchestra.run.trial060.stdout:ID="centos"
2026-02-20T14:23:56.308 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel fedora"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="9"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el9"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;31"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://centos.org/"
2026-02-20T14:23:56.309 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T14:23:56.310 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T14:23:56.310 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T14:23:56.311 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server
2026-02-20T14:23:56.428 INFO:teuthology.lock.ops:Updating [trial104.front.sepia.ceph.com]: set os type and version on server
2026-02-20T14:23:56.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com'
2026-02-20T14:23:56.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2026-02-20T14:23:56.487 DEBUG:teuthology.orchestra.run.trial104:> true
2026-02-20T14:23:56.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com'
2026-02-20T14:23:56.561 DEBUG:teuthology.orchestra.run.trial104:> uname -m
2026-02-20T14:23:56.616 INFO:teuthology.orchestra.run.trial104.stdout:x86_64
2026-02-20T14:23:56.617 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:NAME="CentOS Stream"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="9"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:ID="centos"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel fedora"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="9"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el9"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="CentOS Stream 9"
2026-02-20T14:23:56.673 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;31"
2026-02-20T14:23:56.674 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon"
2026-02-20T14:23:56.674 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2026-02-20T14:23:56.674 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://centos.org/"
2026-02-20T14:23:56.674 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://issues.redhat.com/"
2026-02-20T14:23:56.674 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2026-02-20T14:23:56.674 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2026-02-20T14:23:56.675 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server
2026-02-20T14:23:56.791 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:23:56.884 INFO:teuthology.dispatcher.supervisor:Running job 60359
2026-02-20T14:23:56.884 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/virtualenv/bin/teuthology -v --owner scheduled_vshankar@soko04.front.sepia.ceph.com --archive /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60359 --name vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial --description fs/functional/{0-use-snaprealm/{global} begin/{0-install 1-ceph 2-logrotate 3-kernel} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/xfstests-dev} -- /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60359/orig.config.yaml
2026-02-20T14:23:56.885 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/mnt/teuthology/vshankar-2026-02-20_09:38:02-fs-wip-vshankar-testing-20260219.125903-testing-default-trial/60359
2026-02-20T14:23:56.885 INFO:teuthology.dispatcher.supervisor:Job PID: 2429609
2026-02-20T14:23:56.885 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2026-02-20T14:25:56.972 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:27:57.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:29:57.374 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:31:57.577 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:33:57.779 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:35:57.987 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:37:58.079 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:39:58.277 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:41:58.396 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:43:58.598 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:45:58.822 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:47:59.023 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:49:59.204 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:51:59.387 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:53:59.559 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:55:59.756 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:57:59.867 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T14:59:59.998 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:02:00.226 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:04:00.452 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:06:00.640 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:08:00.768 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:10:00.928 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:12:01.120 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:14:01.345 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:16:01.546 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:18:01.736 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:20:01.944 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:22:02.100 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:24:02.225 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:26:02.436 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:28:02.614 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:30:04.110 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:32:04.449 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:34:04.582 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:36:04.728 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:38:04.951 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:40:05.135 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:42:05.324 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:44:05.478 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:46:05.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:48:05.796 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:50:06.026 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:52:06.207 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:54:06.400 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:56:06.597 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T15:58:06.791 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:00:06.938 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:02:07.131 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:04:07.315 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:06:07.430 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:08:07.641 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:10:07.836 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:12:08.044 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:14:08.229 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:16:08.406 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:18:08.580 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:20:08.757 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:22:08.945 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:24:09.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:26:09.317 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:28:09.458 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:30:10.686 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:32:10.906 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:34:11.076 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:36:11.259 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:38:11.447 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:40:11.601 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:42:11.774 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:44:11.971 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:46:12.113 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:48:12.287 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:50:12.463 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:52:12.636 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:54:12.839 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:56:13.056 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:58:13.231 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com
2026-02-20T16:58:13.332 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2026-02-20T16:58:13.443 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2026-02-20T16:58:13.962 INFO:teuthology.orchestra.console.trial060:Power off
2026-02-20T16:58:13.962 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T16:58:13.973 INFO:teuthology.orchestra.console.trial104:Power off
2026-02-20T16:58:13.973 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2026-02-20T16:58:14.002 DEBUG:teuthology.orchestra.console.trial060:power off output: Chassis Power Control: Down/Off
2026-02-20T16:58:14.014 DEBUG:teuthology.orchestra.console.trial104:power off output: Chassis Power Control: Down/Off
2026-02-20T16:58:18.007 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:58:18.014 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:58:18.116 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is on
2026-02-20T16:58:18.121 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is on
2026-02-20T16:58:22.120 DEBUG:teuthology.orchestra.console.trial060:pexpect command: ipmitool -H trial060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:58:22.126 DEBUG:teuthology.orchestra.console.trial104:pexpect command: ipmitool -H trial104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2026-02-20T16:58:22.228 DEBUG:teuthology.orchestra.console.trial060:check power output: Chassis Power is off
2026-02-20T16:58:22.229 INFO:teuthology.orchestra.console.trial060:Power off completed
2026-02-20T16:58:22.234 DEBUG:teuthology.orchestra.console.trial104:check power output: Chassis Power is off
2026-02-20T16:58:22.234 INFO:teuthology.orchestra.console.trial104:Power off completed
2026-02-20T16:58:22.486 INFO:teuthology.lock.ops:unlocked: trial060.front.sepia.ceph.com
2026-02-20T16:58:22.489 INFO:teuthology.lock.ops:unlocked: trial104.front.sepia.ceph.com