2024-01-17T12:42:29.130 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-17T12:42:29.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:42:29.261 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f465d659f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f465e6bfc10>, signals=[15])
2024-01-17T12:42:29.261 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging
2024-01-17T12:42:29.261 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T12:42:29.261 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2024-01-17T12:42:29.284 INFO:teuthology.lock.ops:Start node 'smithi071.front.sepia.ceph.com' reimaging
2024-01-17T12:42:29.284 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: reset os type and version on server
2024-01-17T12:42:29.284 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server
2024-01-17T12:42:29.390 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10)
2024-01-17T12:42:29.412 DEBUG:teuthology.provision.fog.smithi071:Requesting image smithi_centos_9.stream (ID 10)
2024-01-17T12:42:29.427 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream
2024-01-17T12:42:29.448 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 9.stream
2024-01-17T12:42:29.661 INFO:teuthology.orchestra.console.smithi069:Power off
2024-01-17T12:42:29.661 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T12:42:29.673 INFO:teuthology.orchestra.console.smithi071:Power off
2024-01-17T12:42:29.673 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T12:42:29.681 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off
2024-01-17T12:42:29.682 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:29.692 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off
2024-01-17T12:42:29.692 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:29.702 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2024-01-17T12:42:29.711 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-01-17T12:42:29.811 INFO:teuthology.orchestra.console.smithi071:Power off completed
2024-01-17T12:42:29.912 INFO:teuthology.orchestra.console.smithi071:Power on
2024-01-17T12:42:29.912 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T12:42:29.931 DEBUG:teuthology.orchestra.console.smithi071:power on output: Chassis Power Control: Up/On
2024-01-17T12:42:29.931 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:29.950 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-01-17T12:42:33.704 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:33.812 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2024-01-17T12:42:33.952 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:34.059 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-01-17T12:42:37.816 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:37.923 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2024-01-17T12:42:38.060 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:38.178 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is on
2024-01-17T12:42:38.278 INFO:teuthology.orchestra.console.smithi071:Power on completed
2024-01-17T12:42:38.379 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish
2024-01-17T12:42:41.928 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:42.036 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-17T12:42:42.136 INFO:teuthology.orchestra.console.smithi069:Power off completed
2024-01-17T12:42:42.237 INFO:teuthology.orchestra.console.smithi069:Power on
2024-01-17T12:42:42.237 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-17T12:42:42.259 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On
2024-01-17T12:42:42.259 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:42.281 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-17T12:42:46.284 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T12:42:46.393 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2024-01-17T12:42:46.494 INFO:teuthology.orchestra.console.smithi069:Power on completed
2024-01-17T12:42:46.595 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish
2024-01-17T12:45:24.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:45:43.356 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-01-17T12:45:48.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:45:49.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:45:52.412 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-01-17T12:45:58.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:01.468 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-01-17T12:46:03.327 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2024-01-17T12:46:03.353 ERROR:paramiko.transport:Traceback (most recent call last):
2024-01-17T12:46:03.353 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2327, in _check_banner
2024-01-17T12:46:03.353 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2024-01-17T12:46:03.353 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 381, in readline
2024-01-17T12:46:03.353 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2024-01-17T12:46:03.353 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 626, in _read_timeout
2024-01-17T12:46:03.354 ERROR:paramiko.transport:    raise socket.timeout()
2024-01-17T12:46:03.354 ERROR:paramiko.transport:socket.timeout
2024-01-17T12:46:03.354 ERROR:paramiko.transport:
2024-01-17T12:46:03.354 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2024-01-17T12:46:03.354 ERROR:paramiko.transport:
2024-01-17T12:46:03.354 ERROR:paramiko.transport:Traceback (most recent call last):
2024-01-17T12:46:03.354 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2143, in run
2024-01-17T12:46:03.354 ERROR:paramiko.transport:    self._check_banner()
2024-01-17T12:46:03.354 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2331, in _check_banner
2024-01-17T12:46:03.354 ERROR:paramiko.transport:    raise SSHException(
2024-01-17T12:46:03.354 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2024-01-17T12:46:03.354 ERROR:paramiko.transport:
2024-01-17T12:46:03.354 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: SSHException('Error reading SSH protocol banner') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2327, in _check_banner
    buf = self.packetizer.readline(timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 381, in readline
    buf += self._read_timeout(timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 626, in _read_timeout
    raise socket.timeout()
socket.timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 451, in connect
    t.start_client(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 738, in start_client
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2143, in run
    self._check_banner()
  File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2331, in _check_banner
    raise SSHException(
paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2024-01-17T12:46:07.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:10.428 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:46:10.524 WARNING:teuthology.provision.fog.smithi071:[Errno None] Unable to connect to port 22 on 172.21.15.71
2024-01-17T12:46:16.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:16.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:18.684 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:46:24.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:25.340 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:46:31.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:31.996 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:46:38.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:38.652 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:46:44.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:46:45.308 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:46:51.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:01.692 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:47:07.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:10.780 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:47:16.532 WARNING:teuthology.provision.fog.smithi071:timed out
2024-01-17T12:47:16.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:18.332 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:47:22.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:22.936 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T12:47:22.937 DEBUG:teuthology.orchestra.run.smithi071:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T12:47:23.239 INFO:teuthology.provision.fog.smithi071:Node is ready
2024-01-17T12:47:23.239 DEBUG:teuthology.orchestra.run.smithi071:> hostname
2024-01-17T12:47:23.253 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com
2024-01-17T12:47:23.254 DEBUG:teuthology.orchestra.run.smithi071:> grep smithi071.front.sepia.ceph.com /etc/hosts
2024-01-17T12:47:23.309 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071
2024-01-17T12:47:23.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071
2024-01-17T12:47:23.410 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hosts
2024-01-17T12:47:23.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/172.21.15.71/172.21.15.71/g' /etc/hosts
2024-01-17T12:47:23.504 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i -e 's/smithi071.front.sepia.ceph.com/smithi071/g' /etc/hostname
2024-01-17T12:47:23.571 DEBUG:teuthology.orchestra.run.smithi071:> sudo hostname smithi071
2024-01-17T12:47:23.637 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release
2024-01-17T12:47:23.691 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-17T12:47:23.692 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-17T12:47:23.693 INFO:teuthology.provision.fog.smithi071:Deploy complete!
2024-01-17T12:47:23.694 DEBUG:teuthology.parallel:result is None
2024-01-17T12:47:24.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:27.388 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2024-01-17T12:47:33.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:33.668 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-17T12:47:33.668 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-17T12:47:49.055 INFO:teuthology.provision.fog.smithi069:Node is ready
2024-01-17T12:47:49.056 DEBUG:teuthology.orchestra.run.smithi069:> hostname
2024-01-17T12:47:49.074 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com
2024-01-17T12:47:49.074 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts
2024-01-17T12:47:49.131 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069
2024-01-17T12:47:49.132 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069
2024-01-17T12:47:49.234 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts
2024-01-17T12:47:49.264 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts
2024-01-17T12:47:49.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname
2024-01-17T12:47:49.402 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069
2024-01-17T12:47:49.470 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T12:47:49.525 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-17T12:47:49.526 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-17T12:47:49.526 INFO:teuthology.provision.fog.smithi069:Deploy complete!
2024-01-17T12:47:49.526 DEBUG:teuthology.parallel:result is None
2024-01-17T12:47:49.695 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com
2024-01-17T12:47:49.696 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T12:47:49.722 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com
2024-01-17T12:47:49.723 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-17T12:47:49.740 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server
2024-01-17T12:47:49.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com'
2024-01-17T12:47:49.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:49.825 DEBUG:teuthology.orchestra.run.smithi069:> true
2024-01-17T12:47:49.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com'
2024-01-17T12:47:49.890 DEBUG:teuthology.orchestra.run.smithi069:> uname -m
2024-01-17T12:47:49.944 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64
2024-01-17T12:47:49.944 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release
2024-01-17T12:47:49.998 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream"
2024-01-17T12:47:49.998 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9"
2024-01-17T12:47:49.998 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos"
2024-01-17T12:47:49.998 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora"
2024-01-17T12:47:49.998 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-17T12:47:49.999 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-17T12:47:49.999 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2024-01-17T12:47:50.022 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server
2024-01-17T12:47:50.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com'
2024-01-17T12:47:50.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-17T12:47:50.107 DEBUG:teuthology.orchestra.run.smithi071:> true
2024-01-17T12:47:50.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com'
2024-01-17T12:47:50.274 DEBUG:teuthology.orchestra.run.smithi071:> uname -m
2024-01-17T12:47:50.328 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64
2024-01-17T12:47:50.328 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release
2024-01-17T12:47:50.382 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream"
2024-01-17T12:47:50.382 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="9"
2024-01-17T12:47:50.382 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos"
2024-01-17T12:47:50.382 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora"
2024-01-17T12:47:50.382 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="9"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el9"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:LOGO="fedora-logo-icon"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-17T12:47:50.383 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-17T12:47:50.383 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server
2024-01-17T12:47:50.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:47:50.492 INFO:teuthology.dispatcher.supervisor:Running job 7518792
2024-01-17T12:47:50.492 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2024-01-17_12:41:29-crimson-rados-wip-matanb-crimson-testing-17.1-distro-crimson-smithi/7518792 --name matan-2024-01-17_12:41:29-crimson-rados-wip-matanb-crimson-testing-17.1-distro-crimson-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/matan-2024-01-17_12:41:29-crimson-rados-wip-matanb-crimson-testing-17.1-distro-crimson-smithi/7518792/orig.config.yaml
2024-01-17T12:47:50.495 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2024-01-17_12:41:29-crimson-rados-wip-matanb-crimson-testing-17.1-distro-crimson-smithi/7518792
2024-01-17T12:47:50.495 INFO:teuthology.dispatcher.supervisor:Job PID: 1301322
2024-01-17T12:47:50.496 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-17T12:49:50.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:51:50.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:53:50.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:55:51.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:57:51.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T12:59:51.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:01:51.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:03:51.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:05:51.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:07:52.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:09:52.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:11:52.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:13:52.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:15:52.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-17T13:15:52.658 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-17T13:15:52.743 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-17T13:15:52.743 INFO:teuthology.nuke:Checking targets against current locks
2024-01-17T13:15:52.789 DEBUG:teuthology.nuke:shortname: smithi069
2024-01-17T13:15:52.789 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T13:15:52.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-17_12:41:29-crimson-rados-wip-matanb-crimson-testing-17.1-distro-crimson-smithi/7518792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 12:42:28.158655', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI6Qi5DblL3fnnWP/V2UgQNHCLkxcXUImuJlA26ZJM8hWr6/KZp83G+Te8cqTqnkU4oCiVafp32t6icj2ebHIU4='}
2024-01-17T13:15:52.813 DEBUG:teuthology.nuke:shortname: smithi071
2024-01-17T13:15:52.813 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-17T13:15:52.836 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-01-17_12:41:29-crimson-rados-wip-matanb-crimson-testing-17.1-distro-crimson-smithi/7518792', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-17 12:42:28.160597', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJUcpxt59xVY311RYcLECnYTnbac70ckTaWtmcRLidGc2ZCypvCGLaec1tSrcRmp7r+0lqAFNUL4lVXiIxrCXHA='}
2024-01-17T13:15:52.860 INFO:teuthology.orchestra.console.smithi069:Power off
2024-01-17T13:15:52.861 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T13:15:52.884 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off
2024-01-17T13:15:52.884 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T13:15:52.896 INFO:teuthology.orchestra.console.smithi071:Power off
2024-01-17T13:15:52.897 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-17T13:15:52.904 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2024-01-17T13:15:52.917 DEBUG:teuthology.orchestra.console.smithi071:power off output: Chassis Power Control: Down/Off
2024-01-17T13:15:52.917 DEBUG:teuthology.orchestra.console.smithi071:pexpect command: ipmitool -H smithi071.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-17T13:15:52.937 DEBUG:teuthology.orchestra.console.smithi071:check power output: Chassis Power is off
2024-01-17T13:15:53.005 INFO:teuthology.orchestra.console.smithi069:Power off completed
2024-01-17T13:15:53.038 INFO:teuthology.orchestra.console.smithi071:Power off completed
2024-01-17T13:15:53.157 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com
2024-01-17T13:15:53.181 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com