2024-01-27T03:24:43.580 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-27T03:24:43.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:24:43.753 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5edbc5ef40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5edccc4c10>, signals=[15])
2024-01-27T03:24:43.753 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2024-01-27T03:24:43.753 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T03:24:43.753 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-01-27T03:24:43.778 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging
2024-01-27T03:24:43.778 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T03:24:43.778 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2024-01-27T03:24:43.803 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2024-01-27T03:24:43.803 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T03:24:43.803 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-01-27T03:24:43.909 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_8.stream (ID 3)
2024-01-27T03:24:43.938 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_8.stream (ID 3)
2024-01-27T03:24:43.944 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3)
2024-01-27T03:24:43.958 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.stream
2024-01-27T03:24:43.989 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 8.stream
2024-01-27T03:24:43.997 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream
2024-01-27T03:24:44.229 INFO:teuthology.orchestra.console.smithi031:Power off
2024-01-27T03:24:44.229 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T03:24:44.255 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-01-27T03:24:44.255 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:44.269 INFO:teuthology.orchestra.console.smithi191:Power off
2024-01-27T03:24:44.269 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T03:24:44.282 INFO:teuthology.orchestra.console.smithi141:Power off
2024-01-27T03:24:44.282 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T03:24:44.290 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-01-27T03:24:44.291 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-01-27T03:24:44.291 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:44.305 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2024-01-27T03:24:44.305 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:44.316 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-01-27T03:24:44.327 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-27T03:24:48.292 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:48.317 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:48.327 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:48.401 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-01-27T03:24:48.427 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-01-27T03:24:48.435 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-27T03:24:52.404 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:52.428 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:52.436 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:52.513 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-01-27T03:24:52.536 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-01-27T03:24:52.544 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-27T03:24:52.615 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-01-27T03:24:52.637 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-01-27T03:24:52.716 INFO:teuthology.orchestra.console.smithi031:Power on
2024-01-27T03:24:52.717 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T03:24:52.738 INFO:teuthology.orchestra.console.smithi191:Power on
2024-01-27T03:24:52.738 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T03:24:52.749 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On
2024-01-27T03:24:52.750 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:52.763 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2024-01-27T03:24:52.763 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:52.772 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-01-27T03:24:52.784 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-01-27T03:24:56.548 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:56.657 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-27T03:24:56.757 INFO:teuthology.orchestra.console.smithi141:Power off completed
2024-01-27T03:24:56.773 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:56.785 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:56.859 INFO:teuthology.orchestra.console.smithi141:Power on
2024-01-27T03:24:56.859 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T03:24:56.881 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On
2024-01-27T03:24:56.882 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:24:56.888 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-01-27T03:24:56.894 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-01-27T03:24:56.902 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-27T03:24:56.989 INFO:teuthology.orchestra.console.smithi031:Power on completed
2024-01-27T03:24:57.090 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2024-01-27T03:25:00.896 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:25:00.903 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T03:25:01.005 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2024-01-27T03:25:01.011 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-27T03:25:01.106 INFO:teuthology.orchestra.console.smithi191:Power on completed
2024-01-27T03:25:01.111 INFO:teuthology.orchestra.console.smithi141:Power on completed
2024-01-27T03:25:01.207 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2024-01-27T03:25:01.212 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2024-01-27T03:27:28.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:31.168 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-27T03:27:37.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:40.252 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-27T03:27:46.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:47.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:47.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:49.308 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-27T03:27:50.300 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-01-27T03:27:50.300 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-27T03:27:55.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:56.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:56.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:27:58.368 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-27T03:27:59.356 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-01-27T03:27:59.356 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-27T03:28:04.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:05.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:05.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:07.456 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-27T03:28:08.412 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-01-27T03:28:08.412 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-27T03:28:13.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:14.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:14.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:17.468 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-01-27T03:28:17.468 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-27T03:28:23.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:23.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:26.527 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2024-01-27T03:28:26.527 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-27T03:28:32.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:32.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:28:35.612 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-27T03:28:41.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:13.493 WARNING:teuthology.provision.fog.smithi031:timed out
2024-01-27T03:29:19.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:19.726 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T03:29:19.727 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T03:29:19.972 INFO:teuthology.provision.fog.smithi031:Node is ready
2024-01-27T03:29:19.972 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2024-01-27T03:29:19.993 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2024-01-27T03:29:19.993 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2024-01-27T03:29:20.054 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2024-01-27T03:29:20.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-01-27T03:29:20.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2024-01-27T03:29:20.189 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2024-01-27T03:29:20.260 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2024-01-27T03:29:20.331 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-01-27T03:29:20.401 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-01-27T03:29:20.460 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-01-27T03:29:20.460 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8"
2024-01-27T03:29:20.460 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T03:29:20.461 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T03:29:20.462 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2024-01-27T03:29:20.463 DEBUG:teuthology.parallel:result is None
2024-01-27T03:29:32.544 WARNING:teuthology.provision.fog.smithi191:timed out
2024-01-27T03:29:38.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:38.797 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T03:29:38.798 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T03:29:39.065 INFO:teuthology.provision.fog.smithi191:Node is ready
2024-01-27T03:29:39.066 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2024-01-27T03:29:39.086 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2024-01-27T03:29:39.086 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2024-01-27T03:29:39.145 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2024-01-27T03:29:39.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-01-27T03:29:39.236 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2024-01-27T03:29:39.265 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2024-01-27T03:29:39.334 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2024-01-27T03:29:39.402 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2024-01-27T03:29:39.470 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-01-27T03:29:39.527 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T03:29:39.528 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T03:29:39.529 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T03:29:39.529 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2024-01-27T03:29:39.529 DEBUG:teuthology.parallel:result is None
2024-01-27T03:29:41.620 WARNING:teuthology.provision.fog.smithi141:timed out
2024-01-27T03:29:47.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:47.845 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T03:29:47.846 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T03:29:48.099 INFO:teuthology.provision.fog.smithi141:Node is ready
2024-01-27T03:29:48.099 DEBUG:teuthology.orchestra.run.smithi141:> hostname
2024-01-27T03:29:48.118 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2024-01-27T03:29:48.118 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts
2024-01-27T03:29:48.177 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2024-01-27T03:29:48.178 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2024-01-27T03:29:48.283 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts
2024-01-27T03:29:48.313 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts
2024-01-27T03:29:48.382 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname
2024-01-27T03:29:48.451 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2024-01-27T03:29:48.517 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2024-01-27T03:29:48.576 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T03:29:48.577 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2024-01-27T03:29:48.578 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T03:29:48.578 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2024-01-27T03:29:48.578 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T03:29:48.578 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T03:29:48.578 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T03:29:48.578 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2024-01-27T03:29:48.579 DEBUG:teuthology.parallel:result is None
2024-01-27T03:29:48.771 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2024-01-27T03:29:48.772 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T03:29:48.801 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2024-01-27T03:29:48.801 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T03:29:48.825 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2024-01-27T03:29:48.825 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T03:29:48.843 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2024-01-27T03:29:48.843 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-01-27T03:29:48.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:48.920 DEBUG:teuthology.orchestra.run.smithi031:> true
2024-01-27T03:29:49.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-01-27T03:29:49.060 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2024-01-27T03:29:49.121 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2024-01-27T03:29:49.121 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T03:29:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/"
2024-01-27T03:29:49.182 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T03:29:49.182 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T03:29:49.182 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T03:29:49.182 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-01-27T03:29:49.209 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2024-01-27T03:29:49.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2024-01-27T03:29:49.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:49.281 DEBUG:teuthology.orchestra.run.smithi141:> true
2024-01-27T03:29:49.351 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com'
2024-01-27T03:29:49.351 DEBUG:teuthology.orchestra.run.smithi141:> uname -m
2024-01-27T03:29:49.411 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2024-01-27T03:29:49.411 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2024-01-27T03:29:49.470 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2024-01-27T03:29:49.470 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8"
2024-01-27T03:29:49.470 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2024-01-27T03:29:49.470 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2024-01-27T03:29:49.470 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8"
2024-01-27T03:29:49.470 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T03:29:49.471 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T03:29:49.471 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2024-01-27T03:29:49.492 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2024-01-27T03:29:49.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-01-27T03:29:49.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T03:29:49.566 DEBUG:teuthology.orchestra.run.smithi191:> true
2024-01-27T03:29:49.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2024-01-27T03:29:49.638 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2024-01-27T03:29:49.698 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2024-01-27T03:29:49.698 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2024-01-27T03:29:49.757 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2024-01-27T03:29:49.757 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8"
2024-01-27T03:29:49.757 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T03:29:49.758 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-27T03:29:49.759 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2024-01-27T03:29:49.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:29:49.886 INFO:teuthology.dispatcher.supervisor:Running job 7535310
2024-01-27T03:29:49.887 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7535310 --name lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi --description rados:thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/upmap-read mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7535310/orig.config.yaml
2024-01-27T03:29:49.890 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7535310
2024-01-27T03:29:49.890 INFO:teuthology.dispatcher.supervisor:Job PID: 1505159
2024-01-27T03:29:49.890 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-27T03:31:49.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:33:50.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:35:50.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:37:50.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:39:50.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:41:50.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:43:50.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:45:51.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:47:51.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:49:51.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:51:51.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:53:51.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:55:51.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:57:52.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T03:59:52.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:01:52.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:03:52.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:05:52.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:07:52.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:09:53.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:11:53.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:13:53.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:15:53.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:17:53.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:19:53.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:21:54.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:23:54.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:25:54.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:27:54.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:29:54.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:31:54.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:33:55.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:35:55.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:37:55.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:39:55.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:41:55.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:43:55.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:45:56.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:47:56.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:49:56.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:51:56.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:53:56.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:55:56.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:57:57.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T04:59:57.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:01:57.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:03:57.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:05:57.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:07:57.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:09:58.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:11:58.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T05:11:58.288 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-27T05:11:58.507 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-27T05:11:58.507 INFO:teuthology.nuke:Checking targets against current locks
2024-01-27T05:11:58.558 DEBUG:teuthology.nuke:shortname: smithi031
2024-01-27T05:11:58.558 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T05:11:58.577 DEBUG:teuthology.nuke:shortname: smithi141
2024-01-27T05:11:58.577 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T05:11:58.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7535310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 03:24:42.482635', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEPuOZe5y3D9il9sQWROKfkk4zs6HbwFUK6DCSe7qAVSDOpqB2F9sHUOPKotb+ysGYVvjwUrUJZBHgR9C6cQaYc='}
2024-01-27T05:11:58.597 DEBUG:teuthology.nuke:shortname: smithi191
2024-01-27T05:11:58.597 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T05:11:58.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7535310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 03:24:42.481088', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBDz3MaPuPHpRmwNNX5y2FWjboVbs2nIREOa73GIPfGqeO6YbzKzHE9kx90LQnLurNq9McLfhR2xM3iGkWVQv1o='}
2024-01-27T05:11:58.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-27_03:21:58-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7535310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 03:24:42.484051', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI2ejMefCW/huR3ztlAo+Q7NrvwTheyaJtCw44hdgR/ip2OGpSYYWSEY6pZpSMWsCd6OV1d2sB5lR2l8736WDso='}
2024-01-27T05:11:58.631 INFO:teuthology.orchestra.console.smithi031:Power off
2024-01-27T05:11:58.632 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T05:11:58.652 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-01-27T05:11:58.652 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:11:58.668 INFO:teuthology.orchestra.console.smithi191:Power off
2024-01-27T05:11:58.668 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T05:11:58.683 INFO:teuthology.orchestra.console.smithi141:Power off
2024-01-27T05:11:58.683 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T05:11:58.691 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2024-01-27T05:11:58.691 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:11:58.699 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-01-27T05:11:58.705 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2024-01-27T05:11:58.705 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T05:11:58.714 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2024-01-27T05:11:58.728 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-27T05:11:58.800 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-01-27T05:11:58.814 INFO:teuthology.orchestra.console.smithi191:Power off completed
2024-01-27T05:11:58.829 INFO:teuthology.orchestra.console.smithi141:Power off completed
2024-01-27T05:11:58.954 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2024-01-27T05:11:58.963 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com
2024-01-27T05:11:58.979 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com