2024-03-09T15:27:02.708 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-09T15:27:02.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:27:02.880 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1eed3b0c10>, signals=[15]) 2024-03-09T15:27:02.881 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2024-03-09T15:27:02.881 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2024-03-09T15:27:02.881 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-03-09T15:27:02.906 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2024-03-09T15:27:02.907 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2024-03-09T15:27:02.907 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-03-09T15:27:02.930 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2024-03-09T15:27:02.930 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2024-03-09T15:27:02.931 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-03-09T15:27:03.013 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_8.stream (ID 3) 2024-03-09T15:27:03.051 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_8.stream (ID 3) 2024-03-09T15:27:03.055 DEBUG:teuthology.provision.fog.smithi189:Requesting image smithi_centos_8.stream (ID 3) 2024-03-09T15:27:03.066 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream 2024-03-09T15:27:03.100 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 8.stream 2024-03-09T15:27:03.111 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 8.stream 2024-03-09T15:27:03.363 INFO:teuthology.orchestra.console.smithi189:Power off 2024-03-09T15:27:03.363 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:27:03.385 INFO:teuthology.orchestra.console.smithi096:Power off 2024-03-09T15:27:03.386 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:27:03.400 INFO:teuthology.orchestra.console.smithi103:Power off 2024-03-09T15:27:03.400 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:27:03.412 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2024-03-09T15:27:03.413 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:03.421 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off 2024-03-09T15:27:03.421 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:03.430 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-03-09T15:27:03.430 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:03.441 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-03-09T15:27:03.445 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-03-09T15:27:03.453 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-03-09T15:27:03.554 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-03-09T15:27:03.655 INFO:teuthology.orchestra.console.smithi103:Power on 2024-03-09T15:27:03.655 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-09T15:27:03.679 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2024-03-09T15:27:03.680 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:03.707 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-03-09T15:27:07.446 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:07.453 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:07.556 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-03-09T15:27:07.562 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-09T15:27:07.657 INFO:teuthology.orchestra.console.smithi096:Power off completed 2024-03-09T15:27:07.663 INFO:teuthology.orchestra.console.smithi189:Power off completed 2024-03-09T15:27:07.708 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:07.759 INFO:teuthology.orchestra.console.smithi096:Power on 2024-03-09T15:27:07.759 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-09T15:27:07.766 INFO:teuthology.orchestra.console.smithi189:Power on 2024-03-09T15:27:07.766 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-09T15:27:07.783 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2024-03-09T15:27:07.784 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:07.792 DEBUG:teuthology.orchestra.console.smithi189:power on output: Chassis Power Control: Up/On 2024-03-09T15:27:07.792 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:07.806 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-03-09T15:27:07.814 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-09T15:27:07.819 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-03-09T15:27:07.920 INFO:teuthology.orchestra.console.smithi103:Power on completed 2024-03-09T15:27:08.022 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2024-03-09T15:27:11.811 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:11.818 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:11.921 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-03-09T15:27:11.927 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-09T15:27:15.926 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:15.933 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:27:16.035 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-03-09T15:27:16.064 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-03-09T15:27:16.136 INFO:teuthology.orchestra.console.smithi096:Power on completed 2024-03-09T15:27:16.165 INFO:teuthology.orchestra.console.smithi189:Power on completed 2024-03-09T15:27:16.237 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2024-03-09T15:27:16.266 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2024-03-09T15:30:02.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:02.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:02.723 ERROR:teuthology.orchestra.connection:Error authenticating with smithi189.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-09T15:30:05.506 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-03-09T15:30:09.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:11.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:12.258 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:30:14.561 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-03-09T15:30:18.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:20.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:21.310 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:30:23.614 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-03-09T15:30:27.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:29.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:30.370 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:30:32.674 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-03-09T15:30:36.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:38.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:39.422 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:30:41.730 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-03-09T15:30:45.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:47.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:48.482 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:30:50.786 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-03-09T15:30:54.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:56.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:30:57.534 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:31:03.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:31:06.590 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:31:06.727 WARNING:teuthology.provision.fog.smithi189:timed out 2024-03-09T15:31:12.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:31:12.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:31:15.810 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-09T15:31:21.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:31:30.978 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:31:36.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:31:40.034 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-03-09T15:31:46.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:31:48.132 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-09T15:31:48.133 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-09T15:31:53.473 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-09T15:31:53.473 DEBUG:teuthology.orchestra.run.smithi189:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-09T15:31:56.790 WARNING:teuthology.provision.fog.smithi096:timed out 2024-03-09T15:32:02.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:32:03.007 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-09T15:32:03.008 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-09T15:32:03.302 INFO:teuthology.provision.fog.smithi096:Node is ready 2024-03-09T15:32:03.302 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2024-03-09T15:32:03.322 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2024-03-09T15:32:03.322 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2024-03-09T15:32:03.382 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2024-03-09T15:32:03.382 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2024-03-09T15:32:03.486 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2024-03-09T15:32:03.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2024-03-09T15:32:03.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2024-03-09T15:32:03.655 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2024-03-09T15:32:03.722 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2024-03-09T15:32:03.780 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-09T15:32:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-03-09T15:32:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-09T15:32:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-03-09T15:32:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T15:32:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-09T15:32:03.781 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T15:32:03.782 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2024-03-09T15:32:03.783 DEBUG:teuthology.parallel:result is None 2024-03-09T15:32:13.541 INFO:teuthology.provision.fog.smithi103:Node is ready 2024-03-09T15:32:13.541 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2024-03-09T15:32:13.606 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2024-03-09T15:32:13.606 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2024-03-09T15:32:13.667 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2024-03-09T15:32:13.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-03-09T15:32:13.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2024-03-09T15:32:13.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2024-03-09T15:32:13.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2024-03-09T15:32:13.972 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-03-09T15:32:14.043 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-03-09T15:32:14.104 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T15:32:14.105 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-09T15:32:14.106 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T15:32:14.106 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2024-03-09T15:32:14.107 DEBUG:teuthology.parallel:result is None 2024-03-09T15:32:18.948 INFO:teuthology.provision.fog.smithi189:Node is ready 2024-03-09T15:32:18.949 DEBUG:teuthology.orchestra.run.smithi189:> hostname 2024-03-09T15:32:18.973 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2024-03-09T15:32:18.973 DEBUG:teuthology.orchestra.run.smithi189:> grep smithi189.front.sepia.ceph.com /etc/hosts 2024-03-09T15:32:19.034 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2024-03-09T15:32:19.034 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-03-09T15:32:19.144 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hosts 2024-03-09T15:32:19.175 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.189/172.21.15.189/g' /etc/hosts 2024-03-09T15:32:19.245 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi189.front.sepia.ceph.com/smithi189/g' /etc/hostname 2024-03-09T15:32:19.314 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-03-09T15:32:19.381 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-03-09T15:32:19.439 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-03-09T15:32:19.439 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8" 2024-03-09T15:32:19.439 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-09T15:32:19.440 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T15:32:19.440 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2024-03-09T15:32:19.441 DEBUG:teuthology.parallel:result is None 2024-03-09T15:32:19.634 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2024-03-09T15:32:19.635 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-09T15:32:19.648 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2024-03-09T15:32:19.648 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-09T15:32:19.664 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2024-03-09T15:32:19.664 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-09T15:32:19.776 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2024-03-09T15:32:19.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-03-09T15:32:19.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:32:19.851 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-03-09T15:32:19.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-03-09T15:32:19.985 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-03-09T15:32:20.044 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-03-09T15:32:20.044 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-03-09T15:32:20.103 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-03-09T15:32:20.103 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2024-03-09T15:32:20.103 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-03-09T15:32:20.103 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-09T15:32:20.104 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T15:32:20.105 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-03-09T15:32:20.123 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2024-03-09T15:32:20.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-03-09T15:32:20.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:32:20.199 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-03-09T15:32:20.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-03-09T15:32:20.277 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-03-09T15:32:20.339 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-03-09T15:32:20.339 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="8" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="8" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el8" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-09T15:32:20.400 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-03-09T15:32:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T15:32:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-09T15:32:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T15:32:20.401 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-03-09T15:32:20.423 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2024-03-09T15:32:20.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-03-09T15:32:20.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T15:32:20.498 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-03-09T15:32:20.529 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-03-09T15:32:20.530 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-03-09T15:32:20.590 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-03-09T15:32:20.591 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8" 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8" 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8" 2024-03-09T15:32:20.651 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-09T15:32:20.652 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-03-09T15:32:20.652 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-09T15:32:20.652 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-03-09T15:32:20.652 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-09T15:32:20.652 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-09T15:32:20.652 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-09T15:32:20.652 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-03-09T15:32:20.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:32:20.762 INFO:teuthology.dispatcher.supervisor:Running job 7587217 2024-03-09T15:32:20.762 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi/7587217 --name yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} -- /home/teuthworker/archive/yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi/7587217/orig.config.yaml 2024-03-09T15:32:20.765 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi/7587217 2024-03-09T15:32:20.766 INFO:teuthology.dispatcher.supervisor:Job PID: 2811192 2024-03-09T15:32:20.766 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-09T15:34:20.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:36:20.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:38:20.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:40:20.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:42:21.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:44:21.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:46:21.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:48:21.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:48:21.362 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1