2024-04-07T20:15:24.899 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-07T20:15:24.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:15:25.071 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5887ab7c10>, signals=[15]) 2024-04-07T20:15:25.072 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2024-04-07T20:15:25.072 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2024-04-07T20:15:25.072 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-07T20:15:25.093 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-04-07T20:15:25.093 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-04-07T20:15:25.093 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-07T20:15:25.118 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-04-07T20:15:25.118 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-04-07T20:15:25.118 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-07T20:15:25.207 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10) 2024-04-07T20:15:25.231 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-04-07T20:15:25.241 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10) 2024-04-07T20:15:25.260 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream 2024-04-07T20:15:25.279 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-04-07T20:15:25.290 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream 2024-04-07T20:15:25.599 INFO:teuthology.orchestra.console.smithi044:Power off 2024-04-07T20:15:25.599 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-07T20:15:25.611 INFO:teuthology.orchestra.console.smithi112:Power off 2024-04-07T20:15:25.611 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-07T20:15:25.621 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-04-07T20:15:25.622 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:25.633 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-04-07T20:15:25.633 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:25.646 INFO:teuthology.orchestra.console.smithi191:Power off 2024-04-07T20:15:25.646 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-07T20:15:25.654 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-04-07T20:15:25.655 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-07T20:15:25.666 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-04-07T20:15:25.667 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:25.686 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-04-07T20:15:25.755 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-04-07T20:15:25.787 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-04-07T20:15:25.856 INFO:teuthology.orchestra.console.smithi044:Power on 2024-04-07T20:15:25.856 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-07T20:15:25.878 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2024-04-07T20:15:25.879 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:25.888 INFO:teuthology.orchestra.console.smithi191:Power on 2024-04-07T20:15:25.888 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-07T20:15:25.899 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-04-07T20:15:25.910 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-04-07T20:15:25.910 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:25.930 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-04-07T20:15:29.659 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:29.769 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-07T20:15:29.900 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:29.931 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:30.009 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-04-07T20:15:30.040 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-04-07T20:15:30.141 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-04-07T20:15:30.242 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-04-07T20:15:33.770 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:33.878 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-07T20:15:34.010 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:34.119 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-04-07T20:15:34.220 INFO:teuthology.orchestra.console.smithi044:Power on completed 2024-04-07T20:15:34.320 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2024-04-07T20:15:37.882 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:37.994 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-07T20:15:38.095 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-04-07T20:15:38.195 INFO:teuthology.orchestra.console.smithi112:Power on 2024-04-07T20:15:38.196 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-07T20:15:38.218 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-04-07T20:15:38.218 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:38.239 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-04-07T20:15:42.242 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-07T20:15:42.352 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-04-07T20:15:42.453 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-04-07T20:15:42.553 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-04-07T20:17:50.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:17:50.343 ERROR:teuthology.orchestra.connection:Error authenticating with smithi044.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-07T20:18:16.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:19.294 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-07T20:18:25.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:28.350 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-07T20:18:28.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:31.746 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:18:34.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:37.406 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-07T20:18:37.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:40.798 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:18:43.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:46.462 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-07T20:18:46.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:49.854 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:18:52.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:54.346 WARNING:teuthology.provision.fog.smithi044:timed out 2024-04-07T20:18:55.518 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-07T20:18:55.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:18:58.910 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:00.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:01.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:03.422 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-07T20:19:04.574 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-04-07T20:19:04.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:07.966 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:09.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:10.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:12.478 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-07T20:19:13.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:17.022 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:18.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:23.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:26.078 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:32.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:35.134 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:41.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:44.194 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:50.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:19:53.246 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:19:59.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:20:02.302 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:20:08.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:20:10.578 WARNING:teuthology.provision.fog.smithi191:timed out 2024-04-07T20:20:11.358 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:20:16.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:20:17.107 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-07T20:20:17.108 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-07T20:20:17.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:20:17.448 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-04-07T20:20:17.449 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-04-07T20:20:17.463 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-04-07T20:20:17.463 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-04-07T20:20:17.519 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-04-07T20:20:17.520 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-04-07T20:20:17.633 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-04-07T20:20:17.661 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-04-07T20:20:17.728 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-04-07T20:20:17.797 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-04-07T20:20:17.867 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-07T20:20:17.925 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-07T20:20:17.926 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-07T20:20:17.926 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-04-07T20:20:17.928 DEBUG:teuthology.parallel:result is None 2024-04-07T20:20:18.482 WARNING:teuthology.provision.fog.smithi044:timed out 2024-04-07T20:20:20.414 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-04-07T20:20:24.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:20:24.724 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-07T20:20:24.724 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-07T20:20:25.061 INFO:teuthology.provision.fog.smithi044:Node is ready 2024-04-07T20:20:25.061 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2024-04-07T20:20:25.076 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2024-04-07T20:20:25.077 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2024-04-07T20:20:25.135 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2024-04-07T20:20:25.135 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-04-07T20:20:25.245 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2024-04-07T20:20:25.277 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2024-04-07T20:20:25.348 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2024-04-07T20:20:25.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-04-07T20:20:25.489 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-07T20:20:25.547 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-04-07T20:20:25.547 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-07T20:20:25.548 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-07T20:20:25.549 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2024-04-07T20:20:25.549 DEBUG:teuthology.parallel:result is None 2024-04-07T20:20:26.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:21:26.418 WARNING:teuthology.provision.fog.smithi112:timed out 2024-04-07T20:21:32.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:21:32.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-07T20:21:32.754 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-07T20:21:33.079 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-04-07T20:21:33.079 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-04-07T20:21:33.094 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-04-07T20:21:33.094 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-04-07T20:21:33.150 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-04-07T20:21:33.150 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-04-07T20:21:33.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-04-07T20:21:33.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-04-07T20:21:33.344 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-04-07T20:21:33.422 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-04-07T20:21:33.493 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-07T20:21:33.572 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-07T20:21:33.573 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-07T20:21:33.573 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-07T20:21:33.573 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-07T20:21:33.574 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-07T20:21:33.575 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-04-07T20:21:33.575 DEBUG:teuthology.parallel:result is None 2024-04-07T20:21:33.791 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2024-04-07T20:21:33.792 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-07T20:21:33.817 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-04-07T20:21:33.818 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-07T20:21:33.834 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-04-07T20:21:33.834 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-07T20:21:33.852 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2024-04-07T20:21:33.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-07T20:21:33.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:21:33.958 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-07T20:21:34.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-07T20:21:34.145 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-04-07T20:21:34.200 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-04-07T20:21:34.200 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-07T20:21:34.255 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-07T20:21:34.256 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-07T20:21:34.257 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-07T20:21:34.438 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-04-07T20:21:34.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-07T20:21:34.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:21:34.523 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-04-07T20:21:34.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-04-07T20:21:34.593 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-04-07T20:21:34.648 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-04-07T20:21:34.648 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-04-07T20:21:34.702 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-04-07T20:21:34.702 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-04-07T20:21:34.702 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-07T20:21:34.703 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-07T20:21:34.704 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-04-07T20:21:34.726 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-04-07T20:21:34.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-07T20:21:34.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-07T20:21:34.814 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-04-07T20:21:34.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-04-07T20:21:34.984 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-04-07T20:21:35.038 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-04-07T20:21:35.039 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-07T20:21:35.093 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-04-07T20:21:35.094 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-07T20:21:35.094 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-07T20:21:35.094 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-07T20:21:35.094 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-04-07T20:21:35.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:21:35.213 INFO:teuthology.dispatcher.supervisor:Running job 7634257 2024-04-07T20:21:35.214 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-01_20:08:13-orch-main-distro-default-smithi/7634257 --name teuthology-2024-04-01_20:08:13-orch-main-distro-default-smithi --description orch/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/teuthology-2024-04-01_20:08:13-orch-main-distro-default-smithi/7634257/orig.config.yaml 2024-04-07T20:21:35.216 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-01_20:08:13-orch-main-distro-default-smithi/7634257 2024-04-07T20:21:35.217 INFO:teuthology.dispatcher.supervisor:Job PID: 3618165 2024-04-07T20:21:35.217 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-07T20:23:35.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:25:35.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:27:35.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:29:35.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:31:35.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:33:35.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:35:35.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-07T20:35:35.925 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1