2024-03-13T18:39:23.694 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-13T18:39:23.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:39:23.872 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fece539dc10>, signals=[15]) 2024-03-13T18:39:23.873 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-03-13T18:39:23.873 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T18:39:23.873 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-03-13T18:39:23.891 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-03-13T18:39:23.891 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T18:39:23.891 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-13T18:39:23.915 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-03-13T18:39:23.915 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T18:39:23.916 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-03-13T18:39:24.011 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_8.stream (ID 3) 2024-03-13T18:39:24.029 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2024-03-13T18:39:24.048 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2024-03-13T18:39:24.052 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream 2024-03-13T18:39:24.075 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2024-03-13T18:39:24.106 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2024-03-13T18:39:24.420 INFO:teuthology.orchestra.console.smithi099:Power off 2024-03-13T18:39:24.421 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T18:39:24.435 INFO:teuthology.orchestra.console.smithi084:Power off 2024-03-13T18:39:24.435 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T18:39:24.443 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-03-13T18:39:24.443 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:24.462 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-03-13T18:39:24.463 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:24.478 INFO:teuthology.orchestra.console.smithi133:Power off 2024-03-13T18:39:24.478 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T18:39:24.487 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-13T18:39:24.488 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-13T18:39:24.502 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-03-13T18:39:24.502 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:24.525 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-03-13T18:39:24.588 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-03-13T18:39:24.589 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-03-13T18:39:24.627 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-03-13T18:39:24.690 INFO:teuthology.orchestra.console.smithi084:Power on 2024-03-13T18:39:24.690 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T18:39:24.698 INFO:teuthology.orchestra.console.smithi099:Power on 2024-03-13T18:39:24.698 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T18:39:24.715 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-03-13T18:39:24.715 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:24.728 INFO:teuthology.orchestra.console.smithi133:Power on 2024-03-13T18:39:24.728 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T18:39:24.736 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-03-13T18:39:24.737 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:24.746 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-13T18:39:24.753 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-03-13T18:39:24.753 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:24.763 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-13T18:39:24.776 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-03-13T18:39:28.750 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:28.764 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:28.777 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:28.860 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-03-13T18:39:28.872 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-13T18:39:28.885 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-03-13T18:39:32.864 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:32.873 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:32.886 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T18:39:32.976 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-03-13T18:39:32.983 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-13T18:39:32.995 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-13T18:39:33.077 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-03-13T18:39:33.084 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-03-13T18:39:33.096 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-03-13T18:39:33.178 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-03-13T18:39:33.185 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-03-13T18:39:33.197 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-03-13T18:43:20.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:43:51.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:43:51.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:43:54.079 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:43:54.079 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:00.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:00.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:03.134 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:44:03.135 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:09.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:09.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:12.194 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:44:12.195 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:18.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:18.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:20.849 ERROR:teuthology.orchestra.connection:Error authenticating with smithi099.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 457, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 918, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-03-13T18:44:21.246 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:44:21.278 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:27.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:27.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:30.302 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:44:30.334 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:36.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:36.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:39.358 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:44:39.390 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:43.166 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-13T18:44:45.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:45.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:48.418 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-13T18:44:48.446 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-03-13T18:44:49.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:52.222 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-13T18:44:54.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:54.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:58.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:44:58.475 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T18:44:58.476 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T18:45:23.538 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-03-13T18:45:23.539 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-03-13T18:45:23.564 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-03-13T18:45:23.564 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-03-13T18:45:23.624 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-03-13T18:45:23.624 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-03-13T18:45:23.761 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-03-13T18:45:23.793 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-03-13T18:45:23.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-03-13T18:45:23.930 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-03-13T18:45:23.998 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-13T18:45:24.055 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:45:24.056 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:45:24.057 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-03-13T18:45:24.059 DEBUG:teuthology.parallel:result is None 2024-03-13T18:45:27.454 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-13T18:45:54.450 WARNING:teuthology.provision.fog.smithi133:timed out 2024-03-13T18:45:54.451 WARNING:teuthology.provision.fog.smithi084:timed out 2024-03-13T18:46:00.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:46:00.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:46:00.714 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T18:46:00.715 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T18:46:00.807 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T18:46:00.807 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T18:46:00.976 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-03-13T18:46:00.976 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-03-13T18:46:00.995 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-03-13T18:46:00.995 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-03-13T18:46:01.034 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-03-13T18:46:01.035 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-03-13T18:46:01.055 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-03-13T18:46:01.055 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-03-13T18:46:01.094 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-03-13T18:46:01.094 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-03-13T18:46:01.152 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-03-13T18:46:01.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-03-13T18:46:01.163 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-03-13T18:46:01.193 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-03-13T18:46:01.243 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-03-13T18:46:01.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-03-13T18:46:01.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-03-13T18:46:01.333 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-03-13T18:46:01.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-03-13T18:46:01.401 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-03-13T18:46:01.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:46:01.460 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:46:01.461 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-03-13T18:46:01.461 DEBUG:teuthology.parallel:result is None 2024-03-13T18:46:01.473 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-03-13T18:46:01.530 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-03-13T18:46:01.530 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-03-13T18:46:01.530 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-03-13T18:46:01.530 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:46:01.530 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:46:01.531 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:46:01.531 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-03-13T18:46:01.531 DEBUG:teuthology.parallel:result is None 2024-03-13T18:46:01.715 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-03-13T18:46:01.715 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T18:46:01.740 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-03-13T18:46:01.740 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T18:46:01.756 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-03-13T18:46:01.756 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T18:46:01.774 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-03-13T18:46:01.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-13T18:46:01.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:46:01.847 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-03-13T18:46:01.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-03-13T18:46:01.918 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-03-13T18:46:01.977 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-03-13T18:46:01.977 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:46:02.036 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:46:02.037 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-03-13T18:46:02.057 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-03-13T18:46:02.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-13T18:46:02.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:46:02.130 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-13T18:46:02.265 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-13T18:46:02.265 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-03-13T18:46:02.324 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-03-13T18:46:02.324 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-03-13T18:46:02.383 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:46:02.384 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:46:02.384 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:46:02.384 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:46:02.384 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:46:02.384 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-13T18:46:02.407 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-03-13T18:46:02.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-13T18:46:02.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T18:46:02.475 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-03-13T18:46:02.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-13T18:46:02.547 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-03-13T18:46:02.607 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-03-13T18:46:02.607 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-13T18:46:02.666 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-03-13T18:46:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T18:46:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T18:46:02.667 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T18:46:02.667 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-03-13T18:46:02.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:46:02.779 INFO:teuthology.dispatcher.supervisor:Running job 7596974 2024-03-13T18:46:02.779 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-13_14:15:30-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi/7596974 --name yuriw-2024-03-13_14:15:30-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/yuriw-2024-03-13_14:15:30-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi/7596974/orig.config.yaml 2024-03-13T18:46:02.782 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-13_14:15:30-rados-wip-yuri3-testing-2024-03-12-0851-distro-default-smithi/7596974 2024-03-13T18:46:02.782 INFO:teuthology.dispatcher.supervisor:Job PID: 3373107 2024-03-13T18:46:02.782 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-13T18:48:02.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:50:03.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:52:03.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:54:03.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:56:03.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T18:56:03.614 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1