2024-04-10T06:03:23.815 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-10T06:03:23.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:03:24.006 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6bcc9d0f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6bcda31c10>, signals=[15])
2024-04-10T06:03:24.007 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-04-10T06:03:24.007 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T06:03:24.007 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-04-10T06:03:24.035 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2024-04-10T06:03:24.035 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T06:03:24.035 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2024-04-10T06:03:24.059 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2024-04-10T06:03:24.059 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T06:03:24.059 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-04-10T06:03:24.163 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_8.stream (ID 3)
2024-04-10T06:03:24.176 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_8.stream (ID 3)
2024-04-10T06:03:24.216 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3)
2024-04-10T06:03:24.225 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream
2024-04-10T06:03:24.231 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream
2024-04-10T06:03:24.260 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream
2024-04-10T06:03:24.621 INFO:teuthology.orchestra.console.smithi156:Power off
2024-04-10T06:03:24.622 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T06:03:24.649 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-04-10T06:03:24.649 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:24.666 INFO:teuthology.orchestra.console.smithi176:Power off
2024-04-10T06:03:24.666 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T06:03:24.680 INFO:teuthology.orchestra.console.smithi192:Power off
2024-04-10T06:03:24.680 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T06:03:24.688 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-10T06:03:24.689 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2024-04-10T06:03:24.689 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:24.708 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2024-04-10T06:03:24.708 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:24.717 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-10T06:03:24.735 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-04-10T06:03:28.690 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:28.718 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:28.736 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:28.803 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-10T06:03:28.830 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-10T06:03:28.847 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-04-10T06:03:32.808 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:32.831 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:32.847 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:32.918 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-10T06:03:32.940 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-10T06:03:32.955 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-04-10T06:03:33.019 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-04-10T06:03:33.056 INFO:teuthology.orchestra.console.smithi192:Power off completed
2024-04-10T06:03:33.120 INFO:teuthology.orchestra.console.smithi156:Power on
2024-04-10T06:03:33.120 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T06:03:33.145 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-04-10T06:03:33.145 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:33.157 INFO:teuthology.orchestra.console.smithi192:Power on
2024-04-10T06:03:33.158 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T06:03:33.168 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-10T06:03:33.178 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2024-04-10T06:03:33.178 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:33.199 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-04-10T06:03:36.942 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:37.051 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-04-10T06:03:37.153 INFO:teuthology.orchestra.console.smithi176:Power off completed
2024-04-10T06:03:37.169 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:37.200 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:37.254 INFO:teuthology.orchestra.console.smithi176:Power on
2024-04-10T06:03:37.255 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T06:03:37.278 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-10T06:03:37.280 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On
2024-04-10T06:03:37.280 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:37.302 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2024-04-10T06:03:37.310 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2024-04-10T06:03:41.282 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:41.303 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:41.311 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T06:03:41.392 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-10T06:03:41.413 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2024-04-10T06:03:41.435 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2024-04-10T06:03:41.494 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-04-10T06:03:41.513 INFO:teuthology.orchestra.console.smithi176:Power on completed
2024-04-10T06:03:41.536 INFO:teuthology.orchestra.console.smithi192:Power on completed
2024-04-10T06:03:41.595 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-04-10T06:03:41.614 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2024-04-10T06:03:41.637 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2024-04-10T06:06:12.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:27.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:27.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:30.782 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-10T06:06:30.814 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-10T06:06:36.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:36.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:39.838 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-10T06:06:39.870 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-10T06:06:45.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:45.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:48.930 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-10T06:06:48.931 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-10T06:06:54.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:54.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:06:57.982 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-10T06:06:58.014 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-10T06:07:03.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:07:04.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:07:07.038 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-10T06:07:07.070 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-10T06:07:12.749 ERROR:teuthology.orchestra.connection:Error authenticating with smithi192.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect
    server_key = t.get_remote_server_key()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key
    raise SSHException("No existing session")
paramiko.ssh_exception.SSHException: No existing session
2024-04-10T06:07:13.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:07:13.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:07:16.094 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-10T06:07:16.126 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2024-04-10T06:07:22.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:07:22.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:16.754 WARNING:teuthology.provision.fog.smithi192:timed out
2024-04-10T06:08:20.767 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-04-10T06:08:22.101 WARNING:teuthology.provision.fog.smithi156:timed out
2024-04-10T06:08:22.132 WARNING:teuthology.provision.fog.smithi176:timed out
2024-04-10T06:08:22.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:23.011 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T06:08:23.012 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T06:08:23.238 INFO:teuthology.provision.fog.smithi192:Node is ready
2024-04-10T06:08:23.238 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2024-04-10T06:08:23.258 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2024-04-10T06:08:23.258 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2024-04-10T06:08:23.317 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2024-04-10T06:08:23.318 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-04-10T06:08:23.418 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2024-04-10T06:08:23.447 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2024-04-10T06:08:23.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2024-04-10T06:08:23.585 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2024-04-10T06:08:23.653 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-04-10T06:08:23.711 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-10T06:08:23.712 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-04-10T06:08:23.712 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T06:08:23.712 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-10T06:08:23.712 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T06:08:23.712 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2024-04-10T06:08:23.714 DEBUG:teuthology.parallel:result is None
2024-04-10T06:08:28.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:28.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:28.364 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T06:08:28.364 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T06:08:28.406 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T06:08:28.406 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T06:08:28.606 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-04-10T06:08:28.607 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-04-10T06:08:28.625 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-04-10T06:08:28.625 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-04-10T06:08:28.666 INFO:teuthology.provision.fog.smithi176:Node is ready
2024-04-10T06:08:28.667 DEBUG:teuthology.orchestra.run.smithi176:> hostname
2024-04-10T06:08:28.685 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-04-10T06:08:28.686 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-04-10T06:08:28.687 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2024-04-10T06:08:28.687 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts
2024-04-10T06:08:28.746 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2024-04-10T06:08:28.747 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2024-04-10T06:08:28.791 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-04-10T06:08:28.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-04-10T06:08:28.848 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts
2024-04-10T06:08:28.879 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts
2024-04-10T06:08:28.889 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-04-10T06:08:28.949 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname
2024-04-10T06:08:28.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-04-10T06:08:29.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2024-04-10T06:08:29.026 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8"
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8"
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2024-04-10T06:08:29.084 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-10T06:08:29.085 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-04-10T06:08:29.085 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-10T06:08:29.085 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-04-10T06:08:29.085 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T06:08:29.085 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-10T06:08:29.085 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T06:08:29.085 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-04-10T06:08:29.086 DEBUG:teuthology.parallel:result is None
2024-04-10T06:08:29.086 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2024-04-10T06:08:29.145 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-10T06:08:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2024-04-10T06:08:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-10T06:08:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2024-04-10T06:08:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T06:08:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-10T06:08:29.146 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T06:08:29.146 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2024-04-10T06:08:29.147 DEBUG:teuthology.parallel:result is None
2024-04-10T06:08:29.343 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2024-04-10T06:08:29.344 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T06:08:29.365 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2024-04-10T06:08:29.365 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T06:08:29.390 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2024-04-10T06:08:29.390 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-10T06:08:29.408 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2024-04-10T06:08:29.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-04-10T06:08:29.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:29.486 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-04-10T06:08:29.509 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-04-10T06:08:29.509 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2024-04-10T06:08:29.567 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2024-04-10T06:08:29.567 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-10T06:08:29.625 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-04-10T06:08:29.626 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-10T06:08:29.626 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-04-10T06:08:29.626 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T06:08:29.626 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-10T06:08:29.626 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T06:08:29.626 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-04-10T06:08:29.657 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2024-04-10T06:08:29.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2024-04-10T06:08:29.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:29.735 DEBUG:teuthology.orchestra.run.smithi176:> true
2024-04-10T06:08:29.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com'
2024-04-10T06:08:29.763 DEBUG:teuthology.orchestra.run.smithi176:> uname -m
2024-04-10T06:08:29.821 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2024-04-10T06:08:29.822 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2024-04-10T06:08:29.881 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2024-04-10T06:08:29.881 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2024-04-10T06:08:29.881 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-10T06:08:29.882 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T06:08:29.883 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2024-04-10T06:08:29.906 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2024-04-10T06:08:29.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-04-10T06:08:29.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T06:08:29.978 DEBUG:teuthology.orchestra.run.smithi192:> true
2024-04-10T06:08:30.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2024-04-10T06:08:30.052 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2024-04-10T06:08:30.112 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2024-04-10T06:08:30.112 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2024-04-10T06:08:30.172 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2024-04-10T06:08:30.172 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8"
2024-04-10T06:08:30.172 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2024-04-10T06:08:30.172 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-10T06:08:30.173 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T06:08:30.175 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2024-04-10T06:08:30.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:08:30.294 INFO:teuthology.dispatcher.supervisor:Running job 7649192
2024-04-10T06:08:30.294 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-09_14:58:25-rados-wip-yuri4-testing-2024-04-08-1432-distro-default-smithi/7649192 --name yuriw-2024-04-09_14:58:25-rados-wip-yuri4-testing-2024-04-08-1432-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/yuriw-2024-04-09_14:58:25-rados-wip-yuri4-testing-2024-04-08-1432-distro-default-smithi/7649192/orig.config.yaml
2024-04-10T06:08:30.299 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-09_14:58:25-rados-wip-yuri4-testing-2024-04-08-1432-distro-default-smithi/7649192
2024-04-10T06:08:30.299 INFO:teuthology.dispatcher.supervisor:Job PID: 136682
2024-04-10T06:08:30.299 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-10T06:10:30.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:12:30.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:14:30.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:16:30.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:18:31.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:20:31.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:22:31.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:24:31.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:26:31.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:28:32.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:30:32.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:32:32.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:34:32.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:36:32.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:38:32.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:40:32.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:42:33.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:44:33.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:46:33.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:48:33.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:50:33.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:52:33.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:54:34.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:56:34.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T06:58:34.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:00:34.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:02:34.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:04:34.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:06:35.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:08:35.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:10:35.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:12:35.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:14:35.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:16:36.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:18:36.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:20:36.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:22:36.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:24:36.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:26:36.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:28:37.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:30:37.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:32:37.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T07:32:37.478 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1