2023-12-07T17:15:36.923 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-07T17:15:36.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:15:37.059 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6dc8c05dc0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6dc9ce3550>, signals=[15])
2023-12-07T17:15:37.059 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging
2023-12-07T17:15:37.059 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T17:15:37.059 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2023-12-07T17:15:37.104 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2023-12-07T17:15:37.105 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T17:15:37.105 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-12-07T17:15:37.240 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_9.stream (ID 10)
2023-12-07T17:15:37.243 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_9.stream (ID 10)
2023-12-07T17:15:37.291 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 9.stream
2023-12-07T17:15:37.292 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 9.stream
2023-12-07T17:15:37.862 INFO:teuthology.orchestra.console.smithi131:Power off
2023-12-07T17:15:37.862 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T17:15:37.878 INFO:teuthology.orchestra.console.smithi076:Power off
2023-12-07T17:15:37.879 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T17:15:37.887 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2023-12-07T17:15:37.887 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:37.901 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off
2023-12-07T17:15:37.902 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:37.911 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2023-12-07T17:15:37.928 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on
2023-12-07T17:15:41.914 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:41.929 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:42.025 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2023-12-07T17:15:42.043 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on
2023-12-07T17:15:46.030 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:46.044 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:46.140 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2023-12-07T17:15:46.152 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on
2023-12-07T17:15:50.143 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:50.153 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:50.254 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2023-12-07T17:15:50.262 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-07T17:15:50.356 INFO:teuthology.orchestra.console.smithi131:Power off completed
2023-12-07T17:15:50.363 INFO:teuthology.orchestra.console.smithi076:Power off completed
2023-12-07T17:15:50.457 INFO:teuthology.orchestra.console.smithi131:Power on
2023-12-07T17:15:50.458 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T17:15:50.465 INFO:teuthology.orchestra.console.smithi076:Power on
2023-12-07T17:15:50.465 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T17:15:50.479 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On
2023-12-07T17:15:50.479 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:50.487 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On
2023-12-07T17:15:50.487 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:50.500 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2023-12-07T17:15:50.509 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-07T17:15:54.502 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:54.511 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:54.611 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2023-12-07T17:15:54.620 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-07T17:15:54.713 INFO:teuthology.orchestra.console.smithi131:Power on completed
2023-12-07T17:15:54.814 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2023-12-07T17:15:58.622 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T17:15:58.730 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on
2023-12-07T17:15:58.831 INFO:teuthology.orchestra.console.smithi076:Power on completed
2023-12-07T17:15:58.932 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish
2023-12-07T17:18:25.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:18:28.866 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-12-07T17:18:34.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:18:37.922 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-12-07T17:18:43.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:18:45.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:18:45.312 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-07T17:18:47.010 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-12-07T17:18:53.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:18:56.066 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-12-07T17:19:02.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:19:05.122 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-12-07T17:19:11.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:19:14.182 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-12-07T17:19:20.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:19:49.315 WARNING:teuthology.provision.fog.smithi076:timed out
2023-12-07T17:19:55.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:19:58.374 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76
2023-12-07T17:20:04.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:20:20.186 WARNING:teuthology.provision.fog.smithi131:timed out
2023-12-07T17:20:22.886 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76
2023-12-07T17:20:26.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:20:26.434 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T17:20:26.435 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T17:20:26.733 INFO:teuthology.provision.fog.smithi131:Node is ready
2023-12-07T17:20:26.734 DEBUG:teuthology.orchestra.run.smithi131:> hostname
2023-12-07T17:20:26.748 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2023-12-07T17:20:26.749 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts
2023-12-07T17:20:26.803 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2023-12-07T17:20:26.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2023-12-07T17:20:26.903 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts
2023-12-07T17:20:26.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts
2023-12-07T17:20:26.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname
2023-12-07T17:20:27.065 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2023-12-07T17:20:27.131 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2023-12-07T17:20:27.185 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2023-12-07T17:20:27.185 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon"
2023-12-07T17:20:27.186 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-07T17:20:27.187 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2023-12-07T17:20:27.187 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T17:20:27.187 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-07T17:20:27.187 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T17:20:27.188 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2023-12-07T17:20:27.190 DEBUG:teuthology.parallel:result is None
2023-12-07T17:20:28.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:20:28.902 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet
2023-12-07T17:20:28.903 ERROR:paramiko.transport:Traceback (most recent call last):
2023-12-07T17:20:28.903 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2110, in run
2023-12-07T17:20:28.904 ERROR:paramiko.transport:    ptype, m = self.packetizer.read_message()
2023-12-07T17:20:28.904 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
2023-12-07T17:20:28.904 ERROR:paramiko.transport:    header = self.read_all(self.__block_size_in, check_rekey=True)
2023-12-07T17:20:28.904 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
2023-12-07T17:20:28.904 ERROR:paramiko.transport:    x = self.__socket.recv(n)
2023-12-07T17:20:28.904 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv
2023-12-07T17:20:28.904 ERROR:paramiko.transport:    self._wait(self._read_event)
2023-12-07T17:20:28.904 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-12-07T17:20:28.904 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-12-07T17:20:28.904 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet
2023-12-07T17:20:28.904 ERROR:paramiko.transport:
2023-12-07T17:20:31.970 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76
2023-12-07T17:20:37.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:20:41.215 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T17:20:41.215 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T17:21:07.105 INFO:teuthology.provision.fog.smithi076:Node is ready
2023-12-07T17:21:07.105 DEBUG:teuthology.orchestra.run.smithi076:> hostname
2023-12-07T17:21:07.124 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com
2023-12-07T17:21:07.125 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts
2023-12-07T17:21:07.182 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076
2023-12-07T17:21:07.182 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076
2023-12-07T17:21:07.304 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts
2023-12-07T17:21:07.334 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts
2023-12-07T17:21:07.404 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname
2023-12-07T17:21:07.472 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076
2023-12-07T17:21:07.540 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release
2023-12-07T17:21:07.594 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream"
2023-12-07T17:21:07.594 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31"
2023-12-07T17:21:07.595 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon"
2023-12-07T17:21:07.596 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-07T17:21:07.596 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/"
2023-12-07T17:21:07.596 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T17:21:07.596 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-07T17:21:07.596 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T17:21:07.597 INFO:teuthology.provision.fog.smithi076:Deploy complete!
2023-12-07T17:21:07.598 DEBUG:teuthology.parallel:result is None
2023-12-07T17:21:07.795 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com
2023-12-07T17:21:07.796 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T17:21:07.821 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2023-12-07T17:21:07.821 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T17:21:07.839 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server
2023-12-07T17:21:07.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com'
2023-12-07T17:21:07.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:21:07.923 DEBUG:teuthology.orchestra.run.smithi076:> true
2023-12-07T17:21:07.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com'
2023-12-07T17:21:07.948 DEBUG:teuthology.orchestra.run.smithi076:> uname -m
2023-12-07T17:21:08.003 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64
2023-12-07T17:21:08.003 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release
2023-12-07T17:21:08.058 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream"
2023-12-07T17:21:08.058 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9"
2023-12-07T17:21:08.058 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos"
2023-12-07T17:21:08.058 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-07T17:21:08.059 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T17:21:08.060 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2023-12-07T17:21:08.097 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2023-12-07T17:21:08.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-12-07T17:21:08.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T17:21:08.182 DEBUG:teuthology.orchestra.run.smithi131:> true
2023-12-07T17:21:08.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-12-07T17:21:08.348 DEBUG:teuthology.orchestra.run.smithi131:> uname -m
2023-12-07T17:21:08.403 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2023-12-07T17:21:08.403 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2023-12-07T17:21:08.457 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2023-12-07T17:21:08.457 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9"
2023-12-07T17:21:08.457 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2023-12-07T17:21:08.458 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T17:21:08.459 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-07T17:21:08.459 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-07T17:21:08.459 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-12-07T17:21:08.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:21:08.583 INFO:teuthology.dispatcher.supervisor:Running job 7482255
2023-12-07T17:21:08.583 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-07_16:42:12-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7482255 --name yuriw-2023-12-07_16:42:12-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-12-07_16:42:12-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7482255/orig.config.yaml
2023-12-07T17:21:08.587 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-07_16:42:12-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7482255
2023-12-07T17:21:08.587 INFO:teuthology.dispatcher.supervisor:Job PID: 1638066
2023-12-07T17:21:08.587 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-07T17:23:08.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:25:08.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:27:08.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:29:08.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:31:08.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:33:08.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:35:09.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:37:09.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:39:09.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:41:09.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:43:09.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:45:09.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:47:09.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:49:09.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:51:09.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:53:09.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:55:09.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:57:09.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T17:59:10.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:01:10.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:03:10.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:05:10.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:07:10.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:09:10.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:11:10.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:13:10.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:15:10.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:17:10.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:19:10.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:21:10.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:23:10.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:25:10.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:27:10.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:29:11.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:31:11.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:33:11.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:35:11.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:37:11.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:39:11.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:41:11.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:43:11.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:45:11.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:47:11.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:49:11.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:51:12.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:53:12.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:55:12.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:57:12.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T18:59:12.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T19:01:12.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T19:03:12.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T19:05:12.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T19:07:12.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T19:09:12.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T19:09:12.911 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-07T19:09:13.005 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-07T19:09:13.005 INFO:teuthology.nuke:Checking targets against current locks
2023-12-07T19:09:13.054 DEBUG:teuthology.nuke:shortname: smithi076
2023-12-07T19:09:13.054 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T19:09:13.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_16:42:12-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7482255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 17:15:36.030525', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKAZoprGYfVwEhZmrqJ1UAXewX2nlK4ru0J39OywuEC9Jc/iIYHR69fck80ptm7SCHXa0Aok7Wc244wQN+ORyXY='}
2023-12-07T19:09:13.080 DEBUG:teuthology.nuke:shortname: smithi131
2023-12-07T19:09:13.080 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T19:09:13.098 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_16:42:12-rados-wip-yuri2-testing-2023-12-06-1239-distro-default-smithi/7482255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 17:15:36.032224', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJIohyBuItnuQB09ToSMw5PPMtbeRxa6Xid7cgG//l829mWYfOpgH0/dVwHFfP3CRikLMsztSpxHoRvU681w110='}
2023-12-07T19:09:13.124 INFO:teuthology.orchestra.console.smithi076:Power off
2023-12-07T19:09:13.125 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T19:09:13.147 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off
2023-12-07T19:09:13.147 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T19:09:13.164 INFO:teuthology.orchestra.console.smithi131:Power off
2023-12-07T19:09:13.164 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T19:09:13.172 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-07T19:09:13.187 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2023-12-07T19:09:13.187 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T19:09:13.210 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2023-12-07T19:09:13.274 INFO:teuthology.orchestra.console.smithi076:Power off completed
2023-12-07T19:09:13.312 INFO:teuthology.orchestra.console.smithi131:Power off completed
2023-12-07T19:09:13.419 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com
2023-12-07T19:09:13.461 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com