2024-04-15T01:02:14.286 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T01:02:14.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:02:14.467 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f887bbf3c10>, signals=[15]) 2024-04-15T01:02:14.468 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2024-04-15T01:02:14.468 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T01:02:14.468 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-04-15T01:02:14.496 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2024-04-15T01:02:14.497 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T01:02:14.497 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-15T01:02:14.520 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2024-04-15T01:02:14.521 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T01:02:14.521 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-04-15T01:02:14.622 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_8.stream (ID 3) 2024-04-15T01:02:14.648 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_8.stream (ID 3) 2024-04-15T01:02:14.670 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_centos_8.stream (ID 3) 2024-04-15T01:02:14.678 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream 2024-04-15T01:02:14.698 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream 2024-04-15T01:02:14.737 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 8.stream 2024-04-15T01:02:14.995 INFO:teuthology.orchestra.console.smithi027:Power off 2024-04-15T01:02:14.995 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T01:02:15.012 INFO:teuthology.orchestra.console.smithi063:Power off 2024-04-15T01:02:15.012 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T01:02:15.027 INFO:teuthology.orchestra.console.smithi043:Power off 2024-04-15T01:02:15.027 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T01:02:15.037 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2024-04-15T01:02:15.037 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:15.047 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2024-04-15T01:02:15.048 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:15.058 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2024-04-15T01:02:15.058 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:15.069 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-04-15T01:02:15.071 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-04-15T01:02:15.081 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-15T01:02:19.070 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:19.081 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:19.092 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:19.183 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-04-15T01:02:19.194 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-04-15T01:02:19.211 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-15T01:02:23.186 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:23.195 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:23.212 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:23.296 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-04-15T01:02:23.306 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-04-15T01:02:23.322 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-15T01:02:23.397 INFO:teuthology.orchestra.console.smithi027:Power off completed 2024-04-15T01:02:23.407 INFO:teuthology.orchestra.console.smithi063:Power off completed 2024-04-15T01:02:23.498 INFO:teuthology.orchestra.console.smithi027:Power on 2024-04-15T01:02:23.498 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T01:02:23.508 INFO:teuthology.orchestra.console.smithi063:Power on 2024-04-15T01:02:23.508 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T01:02:23.521 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2024-04-15T01:02:23.521 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:23.530 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On 2024-04-15T01:02:23.530 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:23.544 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-04-15T01:02:23.551 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-04-15T01:02:27.326 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:27.436 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-15T01:02:27.537 INFO:teuthology.orchestra.console.smithi043:Power off completed 2024-04-15T01:02:27.545 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:27.553 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:27.638 INFO:teuthology.orchestra.console.smithi043:Power on 2024-04-15T01:02:27.638 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T01:02:27.656 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-04-15T01:02:27.660 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2024-04-15T01:02:27.660 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:27.674 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-04-15T01:02:27.687 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-15T01:02:31.658 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:31.675 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:31.687 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:31.768 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-04-15T01:02:31.789 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-04-15T01:02:31.799 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2024-04-15T01:02:31.869 INFO:teuthology.orchestra.console.smithi027:Power on completed 2024-04-15T01:02:31.890 INFO:teuthology.orchestra.console.smithi063:Power on completed 2024-04-15T01:02:31.970 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2024-04-15T01:02:31.991 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2024-04-15T01:02:35.802 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T01:02:35.911 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2024-04-15T01:02:36.012 INFO:teuthology.orchestra.console.smithi043:Power on completed 2024-04-15T01:02:36.113 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2024-04-15T01:05:07.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:10.146 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-15T01:05:16.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:18.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:19.234 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-15T01:05:21.086 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:05:25.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:27.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:28.318 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-15T01:05:30.142 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:05:34.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:36.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:37.378 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-15T01:05:39.202 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:05:43.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:45.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:46.462 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-15T01:05:48.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:48.286 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:05:51.262 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:05:52.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:54.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:55.518 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-04-15T01:05:57.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:05:57.342 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:06:00.322 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:06:01.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:03.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:06.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:06.398 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:06:09.406 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:06:12.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:15.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:18.462 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:06:24.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:27.554 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:06:30.818 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:06:33.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:36.638 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:06:36.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:39.870 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-15T01:06:42.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:45.698 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:06:45.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:46.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T01:06:46.796 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T01:06:51.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:06:54.754 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:07:00.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:07:01.524 WARNING:teuthology.provision.fog.smithi043:timed out 2024-04-15T01:07:03.806 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:07:07.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:07:07.762 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T01:07:07.762 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T01:07:08.002 INFO:teuthology.provision.fog.smithi043:Node is ready 2024-04-15T01:07:08.002 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2024-04-15T01:07:08.062 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2024-04-15T01:07:08.062 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2024-04-15T01:07:08.122 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2024-04-15T01:07:08.122 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-04-15T01:07:08.239 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2024-04-15T01:07:08.270 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2024-04-15T01:07:08.340 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2024-04-15T01:07:08.409 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2024-04-15T01:07:08.477 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-15T01:07:08.535 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-15T01:07:08.535 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2024-04-15T01:07:08.535 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-15T01:07:08.535 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T01:07:08.536 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T01:07:08.537 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2024-04-15T01:07:08.538 DEBUG:teuthology.parallel:result is None 2024-04-15T01:07:09.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:07:12.412 INFO:teuthology.provision.fog.smithi063:Node is ready 2024-04-15T01:07:12.413 DEBUG:teuthology.orchestra.run.smithi063:> hostname 2024-04-15T01:07:12.438 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2024-04-15T01:07:12.438 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts 2024-04-15T01:07:12.500 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2024-04-15T01:07:12.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2024-04-15T01:07:12.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts 2024-04-15T01:07:12.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts 2024-04-15T01:07:12.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname 2024-04-15T01:07:12.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2024-04-15T01:07:12.862 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:07:12.878 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-04-15T01:07:12.937 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-04-15T01:07:12.937 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2024-04-15T01:07:12.937 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T01:07:12.938 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T01:07:12.938 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2024-04-15T01:07:12.939 DEBUG:teuthology.parallel:result is None 2024-04-15T01:07:18.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:07:21.918 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-04-15T01:07:27.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:08:27.983 WARNING:teuthology.provision.fog.smithi027:timed out 2024-04-15T01:08:33.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:08:34.243 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T01:08:34.243 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T01:08:34.527 INFO:teuthology.provision.fog.smithi027:Node is ready 2024-04-15T01:08:34.527 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2024-04-15T01:08:34.548 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2024-04-15T01:08:34.548 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2024-04-15T01:08:34.609 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2024-04-15T01:08:34.610 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-04-15T01:08:34.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2024-04-15T01:08:34.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2024-04-15T01:08:34.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2024-04-15T01:08:34.902 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-04-15T01:08:34.971 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8" 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8" 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2024-04-15T01:08:35.031 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T01:08:35.032 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-04-15T01:08:35.032 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T01:08:35.032 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-04-15T01:08:35.032 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T01:08:35.032 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T01:08:35.032 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T01:08:35.032 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2024-04-15T01:08:35.033 DEBUG:teuthology.parallel:result is None 2024-04-15T01:08:35.233 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2024-04-15T01:08:35.233 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T01:08:35.258 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2024-04-15T01:08:35.258 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T01:08:35.282 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2024-04-15T01:08:35.283 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T01:08:35.300 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2024-04-15T01:08:35.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-15T01:08:35.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:08:35.373 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-04-15T01:08:35.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-04-15T01:08:35.442 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-04-15T01:08:35.501 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-04-15T01:08:35.501 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-04-15T01:08:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-04-15T01:08:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8" 2024-04-15T01:08:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-04-15T01:08:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-04-15T01:08:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8" 2024-04-15T01:08:35.560 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T01:08:35.561 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T01:08:35.561 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-04-15T01:08:35.582 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2024-04-15T01:08:35.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-15T01:08:35.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:08:35.696 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-04-15T01:08:35.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-04-15T01:08:35.791 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-04-15T01:08:35.851 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-04-15T01:08:35.851 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-04-15T01:08:35.911 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T01:08:35.912 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T01:08:35.912 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T01:08:35.912 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-04-15T01:08:35.941 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2024-04-15T01:08:35.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-15T01:08:35.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T01:08:36.016 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-04-15T01:08:36.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-15T01:08:36.153 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-04-15T01:08:36.213 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-04-15T01:08:36.213 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-15T01:08:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-04-15T01:08:36.273 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-15T01:08:36.273 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-04-15T01:08:36.273 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T01:08:36.273 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-15T01:08:36.273 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T01:08:36.273 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-04-15T01:08:36.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:08:36.397 INFO:teuthology.dispatcher.supervisor:Running job 7656246 2024-04-15T01:08:36.397 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-14_21:00:09-rados-squid-distro-default-smithi/7656246 --name teuthology-2024-04-14_21:00:09-rados-squid-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/teuthology-2024-04-14_21:00:09-rados-squid-distro-default-smithi/7656246/orig.config.yaml 2024-04-15T01:08:36.400 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-14_21:00:09-rados-squid-distro-default-smithi/7656246 2024-04-15T01:08:36.400 INFO:teuthology.dispatcher.supervisor:Job PID: 3243867 2024-04-15T01:08:36.400 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-15T01:10:36.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:12:36.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:14:36.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:16:37.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:18:37.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:20:37.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:22:37.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T01:22:37.699 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1