2024-03-20T09:00:12.844 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-20T09:00:12.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:00:13.028 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b55d34c10>, signals=[15]) 2024-03-20T09:00:13.028 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2024-03-20T09:00:13.028 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T09:00:13.029 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-03-20T09:00:13.051 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-03-20T09:00:13.051 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T09:00:13.051 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-03-20T09:00:13.075 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2024-03-20T09:00:13.076 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T09:00:13.076 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-03-20T09:00:13.175 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T09:00:13.179 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T09:00:13.214 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T09:00:13.219 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 9.stream 2024-03-20T09:00:13.225 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2024-03-20T09:00:13.278 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream 2024-03-20T09:00:13.472 INFO:teuthology.orchestra.console.smithi053:Power off 2024-03-20T09:00:13.472 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T09:00:13.499 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2024-03-20T09:00:13.499 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:13.521 INFO:teuthology.orchestra.console.smithi098:Power off 2024-03-20T09:00:13.521 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T09:00:13.536 INFO:teuthology.orchestra.console.smithi151:Power off 2024-03-20T09:00:13.536 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T09:00:13.543 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-03-20T09:00:13.543 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-03-20T09:00:13.544 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:13.559 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2024-03-20T09:00:13.559 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:13.570 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-20T09:00:13.583 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-20T09:00:17.546 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:17.571 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:17.583 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:17.656 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-03-20T09:00:17.681 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-20T09:00:17.693 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-20T09:00:21.661 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:21.682 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:21.694 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:21.770 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-03-20T09:00:21.790 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-20T09:00:21.804 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-20T09:00:21.871 INFO:teuthology.orchestra.console.smithi053:Power off completed 2024-03-20T09:00:21.891 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-03-20T09:00:21.972 INFO:teuthology.orchestra.console.smithi053:Power on 2024-03-20T09:00:21.972 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T09:00:21.992 INFO:teuthology.orchestra.console.smithi098:Power on 2024-03-20T09:00:21.992 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T09:00:22.001 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2024-03-20T09:00:22.001 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:22.013 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-03-20T09:00:22.013 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:22.024 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-03-20T09:00:22.033 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-20T09:00:25.806 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:25.915 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-03-20T09:00:26.017 INFO:teuthology.orchestra.console.smithi151:Power off completed 2024-03-20T09:00:26.026 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:26.034 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:26.119 INFO:teuthology.orchestra.console.smithi151:Power on 2024-03-20T09:00:26.119 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T09:00:26.136 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-03-20T09:00:26.142 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2024-03-20T09:00:26.142 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:26.151 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-20T09:00:26.163 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-03-20T09:00:30.138 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:30.152 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:30.164 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:30.248 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-03-20T09:00:30.262 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-20T09:00:30.273 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2024-03-20T09:00:30.349 INFO:teuthology.orchestra.console.smithi053:Power on completed 2024-03-20T09:00:30.363 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-03-20T09:00:30.450 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2024-03-20T09:00:30.464 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-03-20T09:00:34.274 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T09:00:34.384 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2024-03-20T09:00:34.485 INFO:teuthology.orchestra.console.smithi151:Power on completed 2024-03-20T09:00:34.585 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2024-03-20T09:02:46.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:02:49.310 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-03-20T09:02:55.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:02:58.366 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-03-20T09:03:01.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:04.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:04.414 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-20T09:03:07.426 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-03-20T09:03:10.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:13.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:13.474 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-20T09:03:16.510 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-03-20T09:03:19.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:20.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:22.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:22.558 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-20T09:03:23.486 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:03:25.566 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-03-20T09:03:28.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:29.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:31.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:31.618 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-20T09:03:32.542 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:03:37.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:38.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:40.702 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-20T09:03:41.598 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:03:46.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:47.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:49.762 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-20T09:03:50.658 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:03:55.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:56.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:03:59.742 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:04:05.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:04:08.798 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:04:14.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:04:17.858 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:04:23.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:04:31.578 WARNING:teuthology.provision.fog.smithi053:timed out 2024-03-20T09:04:37.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:04:37.819 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T09:04:37.819 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T09:04:38.167 INFO:teuthology.provision.fog.smithi053:Node is ready 2024-03-20T09:04:38.167 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2024-03-20T09:04:38.182 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2024-03-20T09:04:38.183 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2024-03-20T09:04:38.237 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2024-03-20T09:04:38.238 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2024-03-20T09:04:38.365 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2024-03-20T09:04:38.396 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2024-03-20T09:04:38.467 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2024-03-20T09:04:38.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2024-03-20T09:04:38.609 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-03-20T09:04:38.667 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-03-20T09:04:38.668 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T09:04:38.668 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-03-20T09:04:38.668 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T09:04:38.668 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T09:04:38.668 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T09:04:38.668 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2024-03-20T09:04:38.670 DEBUG:teuthology.parallel:result is None 2024-03-20T09:04:42.270 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:04:48.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:04:51.326 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-03-20T09:04:55.770 WARNING:teuthology.provision.fog.smithi098:timed out 2024-03-20T09:04:57.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:05:00.607 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T09:05:00.607 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T09:05:01.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:05:01.988 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T09:05:01.989 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T09:05:02.316 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-03-20T09:05:02.316 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-03-20T09:05:02.331 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2024-03-20T09:05:02.331 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2024-03-20T09:05:02.386 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2024-03-20T09:05:02.386 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-03-20T09:05:02.501 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2024-03-20T09:05:02.528 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2024-03-20T09:05:02.596 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2024-03-20T09:05:02.662 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-03-20T09:05:02.729 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-03-20T09:05:02.784 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T09:05:02.785 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T09:05:02.785 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T09:05:02.785 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2024-03-20T09:05:02.785 DEBUG:teuthology.parallel:result is None 2024-03-20T09:05:26.186 INFO:teuthology.provision.fog.smithi151:Node is ready 2024-03-20T09:05:26.186 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2024-03-20T09:05:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2024-03-20T09:05:26.205 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2024-03-20T09:05:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2024-03-20T09:05:26.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2024-03-20T09:05:26.409 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2024-03-20T09:05:26.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2024-03-20T09:05:26.510 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2024-03-20T09:05:26.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2024-03-20T09:05:26.650 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-03-20T09:05:26.705 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-03-20T09:05:26.705 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-03-20T09:05:26.706 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-03-20T09:05:26.707 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T09:05:26.707 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-03-20T09:05:26.707 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T09:05:26.707 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T09:05:26.707 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T09:05:26.707 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2024-03-20T09:05:26.708 DEBUG:teuthology.parallel:result is None 2024-03-20T09:05:26.939 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2024-03-20T09:05:26.940 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T09:05:26.965 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2024-03-20T09:05:26.965 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T09:05:26.981 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2024-03-20T09:05:26.982 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T09:05:26.999 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2024-03-20T09:05:26.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-03-20T09:05:27.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:05:27.104 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-03-20T09:05:27.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-03-20T09:05:27.289 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-03-20T09:05:27.344 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-03-20T09:05:27.344 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-03-20T09:05:27.400 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-03-20T09:05:27.400 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T09:05:27.401 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T09:05:27.402 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-03-20T09:05:27.423 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2024-03-20T09:05:27.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-03-20T09:05:27.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:05:27.514 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-03-20T09:05:27.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-03-20T09:05:27.681 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-03-20T09:05:27.735 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-03-20T09:05:27.736 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-03-20T09:05:27.791 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-03-20T09:05:27.791 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-03-20T09:05:27.791 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T09:05:27.792 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T09:05:27.793 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-03-20T09:05:27.815 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2024-03-20T09:05:27.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-20T09:05:27.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T09:05:27.910 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-03-20T09:05:27.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-03-20T09:05:27.987 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-03-20T09:05:28.044 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-03-20T09:05:28.044 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T09:05:28.101 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T09:05:28.102 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T09:05:28.102 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-03-20T09:05:28.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:05:28.212 INFO:teuthology.dispatcher.supervisor:Running job 7611972 2024-03-20T09:05:28.212 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2024-03-20_08:55:22-orch:cephadm-wip-guits-testing-6-2024-03-19-1303-distro-default-smithi/7611972 --name gabrioux-2024-03-20_08:55:22-orch:cephadm-wip-guits-testing-6-2024-03-19-1303-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/gabrioux-2024-03-20_08:55:22-orch:cephadm-wip-guits-testing-6-2024-03-19-1303-distro-default-smithi/7611972/orig.config.yaml 2024-03-20T09:05:28.215 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2024-03-20_08:55:22-orch:cephadm-wip-guits-testing-6-2024-03-19-1303-distro-default-smithi/7611972 2024-03-20T09:05:28.216 INFO:teuthology.dispatcher.supervisor:Job PID: 624628 2024-03-20T09:05:28.216 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-20T09:07:28.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:09:28.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:11:28.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:13:28.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:15:29.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:17:29.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:19:29.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:21:29.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:23:29.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T09:23:29.807 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1