2024-01-25T04:35:38.193 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-25T04:35:38.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:35:38.371 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffa9cb32c10>, signals=[15]) 2024-01-25T04:35:38.372 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2024-01-25T04:35:38.372 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2024-01-25T04:35:38.372 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-01-25T04:35:38.388 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2024-01-25T04:35:38.389 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2024-01-25T04:35:38.389 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-01-25T04:35:38.413 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2024-01-25T04:35:38.413 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2024-01-25T04:35:38.413 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-01-25T04:35:38.527 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_8.stream (ID 3) 2024-01-25T04:35:38.537 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3) 2024-01-25T04:35:38.541 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_8.stream (ID 3) 2024-01-25T04:35:38.576 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.stream 2024-01-25T04:35:38.582 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream 2024-01-25T04:35:38.588 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream 2024-01-25T04:35:38.815 INFO:teuthology.orchestra.console.smithi173:Power off 2024-01-25T04:35:38.816 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T04:35:38.829 INFO:teuthology.orchestra.console.smithi137:Power off 2024-01-25T04:35:38.829 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T04:35:38.839 INFO:teuthology.orchestra.console.smithi155:Power off 2024-01-25T04:35:38.839 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T04:35:38.847 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-01-25T04:35:38.847 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:38.855 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-01-25T04:35:38.856 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:38.864 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2024-01-25T04:35:38.864 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:38.872 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-01-25T04:35:38.877 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-25T04:35:38.902 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-01-25T04:35:42.876 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:42.883 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:42.903 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:42.985 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-01-25T04:35:42.992 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-25T04:35:43.011 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-01-25T04:35:46.988 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:46.995 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:47.012 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:47.097 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-25T04:35:47.104 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-25T04:35:47.120 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-01-25T04:35:47.198 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-01-25T04:35:47.209 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-01-25T04:35:47.310 INFO:teuthology.orchestra.console.smithi173:Power on 2024-01-25T04:35:47.310 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-25T04:35:47.318 INFO:teuthology.orchestra.console.smithi137:Power on 2024-01-25T04:35:47.318 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-25T04:35:47.332 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2024-01-25T04:35:47.333 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:47.344 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2024-01-25T04:35:47.344 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:47.356 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-25T04:35:47.363 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-25T04:35:51.125 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:51.234 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-01-25T04:35:51.335 INFO:teuthology.orchestra.console.smithi155:Power off completed 2024-01-25T04:35:51.357 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:51.364 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:51.437 INFO:teuthology.orchestra.console.smithi155:Power on 2024-01-25T04:35:51.438 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-25T04:35:51.459 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2024-01-25T04:35:51.460 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:51.469 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-25T04:35:51.473 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-25T04:35:51.482 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-01-25T04:35:55.474 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:55.481 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:55.487 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:55.589 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-01-25T04:35:55.596 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-01-25T04:35:55.690 INFO:teuthology.orchestra.console.smithi137:Power on completed 2024-01-25T04:35:55.696 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-01-25T04:35:55.792 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2024-01-25T04:35:55.797 INFO:teuthology.orchestra.console.smithi173:Power on completed 2024-01-25T04:35:55.897 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2024-01-25T04:35:59.600 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T04:35:59.709 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-01-25T04:35:59.810 INFO:teuthology.orchestra.console.smithi155:Power on completed 2024-01-25T04:35:59.911 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2024-01-25T04:38:41.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:38:41.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:38:45.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:00.160 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-25T04:39:00.160 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-25T04:39:04.252 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-01-25T04:39:06.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:06.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:09.248 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-25T04:39:09.249 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-25T04:39:10.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:13.312 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-01-25T04:39:15.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:15.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:18.336 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-25T04:39:18.336 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-25T04:39:19.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:22.368 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-01-25T04:39:24.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:24.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:27.420 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-25T04:39:27.420 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-01-25T04:39:28.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:31.456 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-01-25T04:39:33.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:33.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:36.476 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-01-25T04:39:37.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:40.512 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-01-25T04:39:42.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:46.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:39:49.596 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-01-25T04:39:55.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:40:33.446 WARNING:teuthology.provision.fog.smithi137:timed out 2024-01-25T04:40:39.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:40:39.678 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-25T04:40:39.678 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-25T04:40:39.963 INFO:teuthology.provision.fog.smithi137:Node is ready 2024-01-25T04:40:39.963 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2024-01-25T04:40:40.024 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2024-01-25T04:40:40.025 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2024-01-25T04:40:40.085 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2024-01-25T04:40:40.085 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-01-25T04:40:40.191 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2024-01-25T04:40:40.227 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2024-01-25T04:40:40.297 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2024-01-25T04:40:40.366 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-01-25T04:40:40.435 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-01-25T04:40:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-01-25T04:40:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2024-01-25T04:40:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-01-25T04:40:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-01-25T04:40:40.494 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T04:40:40.495 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T04:40:40.496 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2024-01-25T04:40:40.497 DEBUG:teuthology.parallel:result is None 2024-01-25T04:40:42.483 WARNING:teuthology.provision.fog.smithi173:timed out 2024-01-25T04:40:48.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:40:48.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-25T04:40:48.711 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-25T04:40:48.979 INFO:teuthology.provision.fog.smithi173:Node is ready 2024-01-25T04:40:48.979 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2024-01-25T04:40:48.997 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2024-01-25T04:40:48.998 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2024-01-25T04:40:49.056 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2024-01-25T04:40:49.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-01-25T04:40:49.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2024-01-25T04:40:49.180 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2024-01-25T04:40:49.249 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2024-01-25T04:40:49.317 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-01-25T04:40:49.384 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-25T04:40:49.442 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-01-25T04:40:49.443 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-25T04:40:49.443 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-01-25T04:40:49.443 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T04:40:49.443 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T04:40:49.443 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T04:40:49.443 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2024-01-25T04:40:49.444 DEBUG:teuthology.parallel:result is None 2024-01-25T04:40:55.610 WARNING:teuthology.provision.fog.smithi155:timed out 2024-01-25T04:41:01.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:41:01.961 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-25T04:41:01.961 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-25T04:41:02.198 INFO:teuthology.provision.fog.smithi155:Node is ready 2024-01-25T04:41:02.198 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2024-01-25T04:41:02.218 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2024-01-25T04:41:02.219 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155.front.sepia.ceph.com /etc/hosts 2024-01-25T04:41:02.280 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2024-01-25T04:41:02.280 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2024-01-25T04:41:02.376 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hosts 2024-01-25T04:41:02.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2024-01-25T04:41:02.477 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155.front.sepia.ceph.com/smithi155/g' /etc/hostname 2024-01-25T04:41:02.547 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2024-01-25T04:41:02.616 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-01-25T04:41:02.677 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-01-25T04:41:02.677 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2024-01-25T04:41:02.677 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-01-25T04:41:02.677 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T04:41:02.678 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T04:41:02.679 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2024-01-25T04:41:02.679 DEBUG:teuthology.parallel:result is None 2024-01-25T04:41:02.906 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2024-01-25T04:41:02.907 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-25T04:41:02.931 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2024-01-25T04:41:02.932 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-25T04:41:02.947 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2024-01-25T04:41:02.947 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-25T04:41:02.965 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2024-01-25T04:41:02.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-25T04:41:02.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:41:03.037 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-01-25T04:41:03.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-01-25T04:41:03.131 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-01-25T04:41:03.189 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-01-25T04:41:03.189 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-01-25T04:41:03.248 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T04:41:03.249 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T04:41:03.249 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T04:41:03.249 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-01-25T04:41:03.264 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2024-01-25T04:41:03.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-01-25T04:41:03.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:41:03.335 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-01-25T04:41:03.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-01-25T04:41:03.404 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-01-25T04:41:03.465 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-01-25T04:41:03.465 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-01-25T04:41:03.525 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T04:41:03.526 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T04:41:03.527 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-01-25T04:41:03.548 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2024-01-25T04:41:03.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-25T04:41:03.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T04:41:03.619 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-01-25T04:41:03.751 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-25T04:41:03.752 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-01-25T04:41:03.810 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-01-25T04:41:03.811 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-25T04:41:03.870 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-01-25T04:41:03.871 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T04:41:03.871 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-25T04:41:03.871 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T04:41:03.871 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-01-25T04:41:03.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:41:03.989 INFO:teuthology.dispatcher.supervisor:Running job 7531215 2024-01-25T04:41:03.989 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7531215 --name lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi --description rados:thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/upmap-read mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7531215/orig.config.yaml 2024-01-25T04:41:03.993 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7531215 2024-01-25T04:41:03.993 INFO:teuthology.dispatcher.supervisor:Job PID: 3072984 2024-01-25T04:41:03.993 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-25T04:43:04.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:45:04.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:47:04.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:49:04.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:51:04.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:53:04.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:55:05.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:57:05.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T04:59:05.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:01:05.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:03:05.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:05:05.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:07:06.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:09:06.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:11:06.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:13:06.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:15:06.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:17:06.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:19:06.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:21:07.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:23:07.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:25:07.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:27:07.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:29:07.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:31:07.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:33:08.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:35:08.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:37:08.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:39:08.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:41:08.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:43:08.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:45:09.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:47:09.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:49:09.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:51:09.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:53:09.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:55:09.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:57:09.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T05:59:10.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:01:10.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:03:10.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:05:10.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:07:10.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:09:11.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:11:11.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:13:11.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T06:13:11.412 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-25T06:13:11.599 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-25T06:13:11.600 INFO:teuthology.nuke:Checking targets against current locks 2024-01-25T06:13:11.649 DEBUG:teuthology.nuke:shortname: smithi137 2024-01-25T06:13:11.649 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T06:13:11.675 DEBUG:teuthology.nuke:shortname: smithi155 2024-01-25T06:13:11.675 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T06:13:11.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7531215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 04:35:37.107426', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHZsIf8yrVNhe+7Dwl5bVjfsEJiSx4+/ZSM53T0kPKKh3a5SCNCDev+7TTuLH7DiINXNAZ7XATZnwVNhoqh2Xw='} 2024-01-25T06:13:11.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7531215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 04:35:37.109553', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBODY5g2B6neAZLyu6G9TAbio5///LqtjsuNEtfVCD5nJRuEjO8aBZcxhFcOOTklnLkO/RXqY5KAXxx9VjOYwbOg='} 2024-01-25T06:13:11.704 DEBUG:teuthology.nuke:shortname: smithi173 2024-01-25T06:13:11.704 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T06:13:11.726 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-25_04:32:40-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7531215', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 04:35:37.111289', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJnNg/8KUEgNtdO8NQDbhZWgRXIF1fl7hLRzMJQ75YjfmtEds5zaIOB/7WVHT59F5PgqQwti4c0W5wSQKXnlRIM='} 2024-01-25T06:13:11.731 INFO:teuthology.orchestra.console.smithi137:Power off 2024-01-25T06:13:11.732 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T06:13:11.756 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-01-25T06:13:11.756 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T06:13:11.770 INFO:teuthology.orchestra.console.smithi155:Power off 2024-01-25T06:13:11.770 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T06:13:11.780 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-01-25T06:13:11.791 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2024-01-25T06:13:11.791 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T06:13:11.805 INFO:teuthology.orchestra.console.smithi173:Power off 2024-01-25T06:13:11.805 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T06:13:11.815 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-01-25T06:13:11.826 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-01-25T06:13:11.826 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T06:13:11.849 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-25T06:13:11.881 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-01-25T06:13:11.916 INFO:teuthology.orchestra.console.smithi155:Power off completed 2024-01-25T06:13:11.950 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-01-25T06:13:12.027 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com 2024-01-25T06:13:12.068 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2024-01-25T06:13:12.103 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com