2023-12-15T18:16:38.331 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-15T18:16:38.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:16:38.513 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff18b0ba5b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff18c015940>, signals=[15])
2023-12-15T18:16:38.513 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2023-12-15T18:16:38.513 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2023-12-15T18:16:38.514 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-12-15T18:16:38.539 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-12-15T18:16:38.539 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-12-15T18:16:38.539 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-12-15T18:16:38.563 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2023-12-15T18:16:38.563 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2023-12-15T18:16:38.564 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2023-12-15T18:16:38.660 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-15T18:16:38.673 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-15T18:16:38.704 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-15T18:16:38.723 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6
2023-12-15T18:16:38.733 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6
2023-12-15T18:16:38.745 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6
2023-12-15T18:16:38.941 INFO:teuthology.orchestra.console.smithi088:Power off
2023-12-15T18:16:38.941 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:16:38.958 INFO:teuthology.orchestra.console.smithi161:Power off
2023-12-15T18:16:38.959 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:16:38.970 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-12-15T18:16:38.970 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:38.982 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-12-15T18:16:38.983 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:38.997 INFO:teuthology.orchestra.console.smithi181:Power off
2023-12-15T18:16:38.998 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:16:39.006 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-15T18:16:39.009 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-15T18:16:39.021 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2023-12-15T18:16:39.021 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:39.047 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-12-15T18:16:43.009 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:43.017 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:43.048 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:43.119 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-15T18:16:43.125 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-15T18:16:43.157 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-12-15T18:16:47.121 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:47.130 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:47.158 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:47.232 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-15T18:16:47.240 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-15T18:16:47.270 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-12-15T18:16:47.334 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-12-15T18:16:47.341 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-12-15T18:16:47.435 INFO:teuthology.orchestra.console.smithi088:Power on
2023-12-15T18:16:47.435 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-15T18:16:47.448 INFO:teuthology.orchestra.console.smithi161:Power on
2023-12-15T18:16:47.449 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-15T18:16:47.467 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2023-12-15T18:16:47.468 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:47.477 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2023-12-15T18:16:47.478 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:47.493 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-15T18:16:47.504 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-15T18:16:51.273 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:51.382 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-12-15T18:16:51.483 INFO:teuthology.orchestra.console.smithi181:Power off completed
2023-12-15T18:16:51.494 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:51.505 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:51.585 INFO:teuthology.orchestra.console.smithi181:Power on
2023-12-15T18:16:51.585 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-15T18:16:51.604 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-15T18:16:51.608 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2023-12-15T18:16:51.608 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:51.616 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-15T18:16:51.639 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-12-15T18:16:55.609 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:55.620 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:55.640 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:16:55.722 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2023-12-15T18:16:55.733 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-12-15T18:16:55.755 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-12-15T18:16:55.823 INFO:teuthology.orchestra.console.smithi088:Power on completed
2023-12-15T18:16:55.834 INFO:teuthology.orchestra.console.smithi161:Power on completed
2023-12-15T18:16:55.855 INFO:teuthology.orchestra.console.smithi181:Power on completed
2023-12-15T18:16:55.924 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2023-12-15T18:16:55.935 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-12-15T18:16:55.957 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2023-12-15T18:19:41.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:41.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:41.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:44.886 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:19:44.886 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:19:44.886 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:19:50.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:50.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:50.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:53.974 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:19:53.974 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:19:53.974 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:19:59.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:59.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:19:59.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:03.057 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:20:03.058 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:20:03.061 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:20:09.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:09.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:09.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:12.117 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:20:12.118 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:20:12.145 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:20:18.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:18.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:18.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:21.205 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:20:21.206 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:20:21.206 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:20:27.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:27.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:27.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:30.289 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:20:30.290 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:20:30.290 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:20:36.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:36.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:36.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:39.346 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-12-15T18:20:39.381 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2023-12-15T18:20:39.382 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:20:45.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:45.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:45.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:20:48.433 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-12-15T18:20:54.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:21:45.407 WARNING:teuthology.provision.fog.smithi161:timed out
2023-12-15T18:21:45.408 WARNING:teuthology.provision.fog.smithi181:timed out
2023-12-15T18:21:51.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:21:51.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:21:51.638 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-15T18:21:51.638 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-15T18:21:51.640 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-15T18:21:51.640 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-15T18:21:51.885 INFO:teuthology.provision.fog.smithi181:Node is ready
2023-12-15T18:21:51.885 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2023-12-15T18:21:51.903 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2023-12-15T18:21:51.903 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2023-12-15T18:21:51.913 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-12-15T18:21:51.914 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-12-15T18:21:51.931 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-12-15T18:21:51.932 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-12-15T18:21:51.961 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2023-12-15T18:21:51.961 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2023-12-15T18:21:51.988 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-12-15T18:21:51.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-12-15T18:21:52.084 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2023-12-15T18:21:52.095 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-12-15T18:21:52.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2023-12-15T18:21:52.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-12-15T18:21:52.180 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2023-12-15T18:21:52.190 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-12-15T18:21:52.247 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2023-12-15T18:21:52.257 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-12-15T18:21:52.313 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2023-12-15T18:21:52.323 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-12-15T18:21:52.369 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux"
2023-12-15T18:21:52.369 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:21:52.370 INFO:teuthology.orchestra.run.smithi181.stdout:
2023-12-15T18:21:52.371 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-15T18:21:52.371 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-15T18:21:52.371 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-15T18:21:52.371 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-15T18:21:52.371 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2023-12-15T18:21:52.373 DEBUG:teuthology.parallel:result is None
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-15T18:21:52.379 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-15T18:21:52.380 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-15T18:21:52.380 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-12-15T18:21:52.381 DEBUG:teuthology.parallel:result is None
2023-12-15T18:21:54.443 WARNING:teuthology.provision.fog.smithi088:timed out
2023-12-15T18:22:00.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:22:00.655 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-15T18:22:00.655 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-15T18:22:00.923 INFO:teuthology.provision.fog.smithi088:Node is ready
2023-12-15T18:22:00.924 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2023-12-15T18:22:00.941 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2023-12-15T18:22:00.941 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2023-12-15T18:22:01.000 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2023-12-15T18:22:01.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-12-15T18:22:01.127 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2023-12-15T18:22:01.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2023-12-15T18:22:01.224 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2023-12-15T18:22:01.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2023-12-15T18:22:01.358 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-12-15T18:22:01.415 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-15T18:22:01.416 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-15T18:22:01.417 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2023-12-15T18:22:01.417 DEBUG:teuthology.parallel:result is None
2023-12-15T18:22:01.643 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com
2023-12-15T18:22:01.643 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-15T18:22:01.668 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-12-15T18:22:01.668 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-15T18:22:01.684 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2023-12-15T18:22:01.684 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-15T18:22:01.702 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server
2023-12-15T18:22:01.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-12-15T18:22:01.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:22:01.767 DEBUG:teuthology.orchestra.run.smithi088:> true
2023-12-15T18:22:01.834 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com'
2023-12-15T18:22:01.834 DEBUG:teuthology.orchestra.run.smithi088:> uname -m
2023-12-15T18:22:01.890 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64
2023-12-15T18:22:01.890 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2023-12-15T18:22:01.945 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-15T18:22:01.946 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:22:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:
2023-12-15T18:22:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-15T18:22:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-15T18:22:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-15T18:22:01.947 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-15T18:22:01.947 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-12-15T18:22:01.968 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-12-15T18:22:01.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-15T18:22:01.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:22:02.035 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-12-15T18:22:02.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-12-15T18:22:02.109 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-12-15T18:22:02.170 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-12-15T18:22:02.170 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-12-15T18:22:02.230 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux"
2023-12-15T18:22:02.230 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-15T18:22:02.231 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-15T18:22:02.232 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-12-15T18:22:02.252 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2023-12-15T18:22:02.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-12-15T18:22:02.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:22:02.319 DEBUG:teuthology.orchestra.run.smithi181:> true
2023-12-15T18:22:02.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-12-15T18:22:02.389 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2023-12-15T18:22:02.449 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2023-12-15T18:22:02.450 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2023-12-15T18:22:02.509 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux"
2023-12-15T18:22:02.509 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)"
2023-12-15T18:22:02.509 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel"
2023-12-15T18:22:02.509 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora"
2023-12-15T18:22:02.509 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6"
2023-12-15T18:22:02.509 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-15T18:22:02.510 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-15T18:22:02.511 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2023-12-15T18:22:02.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:22:02.614 INFO:teuthology.dispatcher.supervisor:Running job 7493228
2023-12-15T18:22:02.614 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493228 --name cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi --description rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/connectivity task/test_rgw_multisite} -- /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493228/orig.config.yaml
2023-12-15T18:22:02.618 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493228
2023-12-15T18:22:02.618 INFO:teuthology.dispatcher.supervisor:Job PID: 3040833
2023-12-15T18:22:02.618 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-15T18:24:02.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:26:02.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:28:03.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:30:03.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:32:03.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:34:03.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:36:03.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:38:03.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:40:04.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:42:04.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:44:04.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:44:04.450 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-15T18:44:04.591 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-15T18:44:04.591 INFO:teuthology.nuke:Checking targets against current locks
2023-12-15T18:44:04.635 DEBUG:teuthology.nuke:shortname: smithi088
2023-12-15T18:44:04.636 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-15T18:44:04.666 DEBUG:teuthology.nuke:shortname: smithi161
2023-12-15T18:44:04.667 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-15T18:44:04.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 18:16:37.461274', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLs9d9gyAJ9DGJBlvbUEjJOVQtU60ISRtdLW1sCMAmPd3gj7WyTqdcnlgepgAz2zAvvI2hB5dPzZN2OgZMqCaE='}
2023-12-15T18:44:04.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 18:16:37.460207', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNyeMF6Dk0ISBSealn34+8S2K4z6k8w2JTMq4j+y4VavfgNqJLSfFOL7zuh1hhO5pmtk4BOsiElFx9FEeknI9T8='}
2023-12-15T18:44:04.695 DEBUG:teuthology.nuke:shortname: smithi181
2023-12-15T18:44:04.695 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-15T18:44:04.720 INFO:teuthology.orchestra.console.smithi088:Power off
2023-12-15T18:44:04.720 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:44:04.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 18:16:37.458440', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKgzBkbJsGnbLyis+sEcA3tS0oWIs3OdlXviPBRmj5NGfSPAYHaK6/MTv7QD2HdSW3aZLCB7aeSF0IiOHFvyJWs='}
2023-12-15T18:44:04.754 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2023-12-15T18:44:04.755 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:44:04.773 INFO:teuthology.orchestra.console.smithi161:Power off
2023-12-15T18:44:04.773 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:44:04.782 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2023-12-15T18:44:04.794 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-12-15T18:44:04.795 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:44:04.812 INFO:teuthology.orchestra.console.smithi181:Power off
2023-12-15T18:44:04.812 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:44:04.820 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-12-15T18:44:04.833 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2023-12-15T18:44:04.833 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:44:04.857 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-12-15T18:44:04.882 INFO:teuthology.orchestra.console.smithi088:Power off completed
2023-12-15T18:44:04.921 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-12-15T18:44:04.958 INFO:teuthology.orchestra.console.smithi181:Power off completed
2023-12-15T18:44:05.030 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2023-12-15T18:44:05.071 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-12-15T18:44:05.166 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com