2024-02-09T23:56:49.265 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-09T23:56:49.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T23:56:49.436 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcd1ecc5c10>, signals=[15]) 2024-02-09T23:56:49.437 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2024-02-09T23:56:49.437 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T23:56:49.437 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-02-09T23:56:49.457 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2024-02-09T23:56:49.457 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T23:56:49.458 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-02-09T23:56:49.482 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-02-09T23:56:49.482 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T23:56:49.482 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-02-09T23:56:49.580 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_8.stream (ID 3) 2024-02-09T23:56:49.600 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_8.stream (ID 3) 2024-02-09T23:56:49.624 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_8.stream (ID 3) 2024-02-09T23:56:49.627 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 8.stream 2024-02-09T23:56:49.651 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 8.stream 2024-02-09T23:56:49.676 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream 2024-02-09T23:56:49.922 INFO:teuthology.orchestra.console.smithi046:Power off 2024-02-09T23:56:49.923 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T23:56:49.937 INFO:teuthology.orchestra.console.smithi039:Power off 2024-02-09T23:56:49.937 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T23:56:49.951 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-02-09T23:56:49.951 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:49.959 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-02-09T23:56:49.959 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:49.987 INFO:teuthology.orchestra.console.smithi115:Power off 2024-02-09T23:56:49.987 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T23:56:49.995 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-09T23:56:49.995 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-09T23:56:50.008 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-02-09T23:56:50.008 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:50.029 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-02-09T23:56:50.130 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-02-09T23:56:50.230 INFO:teuthology.orchestra.console.smithi115:Power on 2024-02-09T23:56:50.231 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T23:56:50.253 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-02-09T23:56:50.253 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:50.275 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-02-09T23:56:54.000 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:54.007 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:54.109 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-09T23:56:54.116 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-09T23:56:54.276 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:54.384 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-02-09T23:56:54.485 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-02-09T23:56:54.586 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-02-09T23:56:58.112 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:58.119 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:58.221 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-09T23:56:58.228 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-09T23:56:58.329 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-02-09T23:56:58.430 INFO:teuthology.orchestra.console.smithi039:Power on 2024-02-09T23:56:58.430 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T23:56:58.454 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2024-02-09T23:56:58.454 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:56:58.477 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-09T23:57:02.224 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:57:02.334 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-09T23:57:02.434 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-02-09T23:57:02.478 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:57:02.535 INFO:teuthology.orchestra.console.smithi046:Power on 2024-02-09T23:57:02.536 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T23:57:02.557 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2024-02-09T23:57:02.558 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:57:02.581 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-09T23:57:02.591 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-09T23:57:06.584 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:57:06.592 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:57:06.694 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-02-09T23:57:06.700 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-09T23:57:06.801 INFO:teuthology.orchestra.console.smithi039:Power on completed 2024-02-09T23:57:06.902 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2024-02-09T23:57:10.696 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T23:57:10.806 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-02-09T23:57:10.907 INFO:teuthology.orchestra.console.smithi046:Power on completed 2024-02-09T23:57:11.007 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2024-02-09T23:59:40.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:59:43.644 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-09T23:59:49.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:59:52.736 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-09T23:59:56.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:59:58.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T23:59:59.964 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:01.820 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-10T00:00:05.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:07.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:07.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:09.020 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:10.876 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-10T00:00:11.036 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:00:15.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:16.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:17.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:18.076 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:19.932 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-10T00:00:20.092 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:00:24.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:25.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:26.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:27.132 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:28.992 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-10T00:00:29.148 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:00:33.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:34.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:35.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:36.188 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:38.076 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-02-10T00:00:38.204 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:00:42.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:44.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:44.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:45.248 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:47.260 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:00:51.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:53.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:00:54.336 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:00:56.316 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:01:00.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:02.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:03.420 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-02-10T00:01:05.372 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:01:09.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:11.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:14.428 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:01:20.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:23.488 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T00:01:29.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:44.097 WARNING:teuthology.provision.fog.smithi115:timed out 2024-02-10T00:01:50.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:01:50.325 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-10T00:01:50.326 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-10T00:01:50.585 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-02-10T00:01:50.586 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-02-10T00:01:50.605 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-02-10T00:01:50.605 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-02-10T00:01:50.665 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-02-10T00:01:50.665 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-02-10T00:01:50.770 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-02-10T00:01:50.799 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-02-10T00:01:50.869 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-02-10T00:01:50.937 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-02-10T00:01:51.005 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-02-10T00:01:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-02-10T00:01:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2024-02-10T00:01:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-02-10T00:01:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T00:01:51.064 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T00:01:51.065 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T00:01:51.065 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-02-10T00:01:51.067 DEBUG:teuthology.parallel:result is None 2024-02-10T00:02:09.444 WARNING:teuthology.provision.fog.smithi046:timed out 2024-02-10T00:02:15.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:02:15.693 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-10T00:02:15.693 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-10T00:02:15.938 INFO:teuthology.provision.fog.smithi046:Node is ready 2024-02-10T00:02:15.939 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2024-02-10T00:02:15.958 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2024-02-10T00:02:15.958 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2024-02-10T00:02:16.021 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-02-10T00:02:16.117 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-02-10T00:02:16.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2024-02-10T00:02:16.207 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2024-02-10T00:02:16.280 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2024-02-10T00:02:16.354 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-02-10T00:02:16.426 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T00:02:16.489 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-02-10T00:02:16.490 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T00:02:16.490 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-02-10T00:02:16.490 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T00:02:16.490 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T00:02:16.490 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T00:02:16.490 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2024-02-10T00:02:16.491 DEBUG:teuthology.parallel:result is None 2024-02-10T00:02:29.508 WARNING:teuthology.provision.fog.smithi039:timed out 2024-02-10T00:02:35.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:02:35.731 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-10T00:02:35.731 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-10T00:02:36.002 INFO:teuthology.provision.fog.smithi039:Node is ready 2024-02-10T00:02:36.002 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2024-02-10T00:02:36.021 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2024-02-10T00:02:36.022 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2024-02-10T00:02:36.082 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2024-02-10T00:02:36.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-02-10T00:02:36.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2024-02-10T00:02:36.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2024-02-10T00:02:36.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2024-02-10T00:02:36.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-02-10T00:02:36.439 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-02-10T00:02:36.497 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T00:02:36.498 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T00:02:36.499 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2024-02-10T00:02:36.499 DEBUG:teuthology.parallel:result is None 2024-02-10T00:02:36.686 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2024-02-10T00:02:36.687 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-10T00:02:36.710 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2024-02-10T00:02:36.710 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-10T00:02:36.728 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-02-10T00:02:36.728 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-10T00:02:36.753 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2024-02-10T00:02:36.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-10T00:02:36.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:02:36.834 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-02-10T00:02:36.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-02-10T00:02:36.904 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-02-10T00:02:36.962 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-02-10T00:02:36.963 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-02-10T00:02:37.022 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-02-10T00:02:37.022 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T00:02:37.023 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T00:02:37.024 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-02-10T00:02:37.043 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2024-02-10T00:02:37.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-10T00:02:37.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:02:37.116 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-02-10T00:02:37.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-02-10T00:02:37.251 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-02-10T00:02:37.311 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-02-10T00:02:37.311 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-02-10T00:02:37.371 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-02-10T00:02:37.371 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="8" 2024-02-10T00:02:37.371 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="8" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el8" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T00:02:37.372 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-02-10T00:02:37.373 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T00:02:37.373 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T00:02:37.373 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T00:02:37.373 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-02-10T00:02:37.402 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-02-10T00:02:37.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-02-10T00:02:37.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T00:02:37.474 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-02-10T00:02:37.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-02-10T00:02:37.565 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-02-10T00:02:37.623 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-02-10T00:02:37.623 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T00:02:37.681 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T00:02:37.682 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-10T00:02:37.682 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-02-10T00:02:37.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:02:37.815 INFO:teuthology.dispatcher.supervisor:Running job 7554594 2024-02-10T00:02:37.815 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-09_19:35:36-rados-main-distro-default-smithi/7554594 --name yuriw-2024-02-09_19:35:36-rados-main-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} -- /home/teuthworker/archive/yuriw-2024-02-09_19:35:36-rados-main-distro-default-smithi/7554594/orig.config.yaml 2024-02-10T00:02:37.818 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-09_19:35:36-rados-main-distro-default-smithi/7554594 2024-02-10T00:02:37.818 INFO:teuthology.dispatcher.supervisor:Job PID: 2430292 2024-02-10T00:02:37.818 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-10T00:04:37.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:06:38.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:08:38.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:10:38.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:12:38.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:14:38.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:16:38.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:18:39.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:20:39.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:22:39.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:24:39.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:26:39.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:28:39.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:30:40.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:32:40.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T00:32:40.365 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1