2024-03-22T01:20:01.350 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-22T01:20:01.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:20:01.534 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f75d3451f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f75d44b2c10>, signals=[15])
2024-03-22T01:20:01.535 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging
2024-03-22T01:20:01.535 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server
2024-03-22T01:20:01.535 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2024-03-22T01:20:01.554 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-03-22T01:20:01.554 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-03-22T01:20:01.554 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-03-22T01:20:01.579 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging
2024-03-22T01:20:01.579 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server
2024-03-22T01:20:01.579 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2024-03-22T01:20:01.679 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_8.stream (ID 3)
2024-03-22T01:20:01.711 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3)
2024-03-22T01:20:01.715 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_8.stream (ID 3)
2024-03-22T01:20:01.727 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream
2024-03-22T01:20:01.763 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream
2024-03-22T01:20:01.766 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.stream
2024-03-22T01:20:01.974 INFO:teuthology.orchestra.console.smithi135:Power off
2024-03-22T01:20:01.974 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-22T01:20:02.001 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off
2024-03-22T01:20:02.001 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:02.024 INFO:teuthology.orchestra.console.smithi204:Power off
2024-03-22T01:20:02.025 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-22T01:20:02.039 INFO:teuthology.orchestra.console.smithi142:Power off
2024-03-22T01:20:02.039 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-22T01:20:02.048 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-03-22T01:20:02.049 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off
2024-03-22T01:20:02.049 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:02.062 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-03-22T01:20:02.062 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:02.072 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-03-22T01:20:02.087 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-22T01:20:06.051 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:06.072 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:06.088 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:06.160 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-03-22T01:20:06.187 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-03-22T01:20:06.198 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-22T01:20:10.162 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:10.188 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:10.199 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:10.272 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-03-22T01:20:10.296 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-03-22T01:20:10.308 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-22T01:20:14.274 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:14.298 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:14.309 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:14.384 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-03-22T01:20:14.407 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-03-22T01:20:14.419 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-22T01:20:14.486 INFO:teuthology.orchestra.console.smithi135:Power off completed
2024-03-22T01:20:14.507 INFO:teuthology.orchestra.console.smithi204:Power off completed
2024-03-22T01:20:14.521 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-03-22T01:20:14.587 INFO:teuthology.orchestra.console.smithi135:Power on
2024-03-22T01:20:14.587 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-22T01:20:14.610 INFO:teuthology.orchestra.console.smithi204:Power on
2024-03-22T01:20:14.610 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-22T01:20:14.619 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On
2024-03-22T01:20:14.619 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:14.631 INFO:teuthology.orchestra.console.smithi142:Power on
2024-03-22T01:20:14.631 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-22T01:20:14.641 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On
2024-03-22T01:20:14.642 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:14.652 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-03-22T01:20:14.654 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-03-22T01:20:14.655 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:14.666 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off
2024-03-22T01:20:14.677 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-03-22T01:20:18.654 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:18.667 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:18.678 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:18.763 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off
2024-03-22T01:20:18.776 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on
2024-03-22T01:20:18.786 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-03-22T01:20:18.877 INFO:teuthology.orchestra.console.smithi204:Power on completed
2024-03-22T01:20:18.887 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-03-22T01:20:18.978 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2024-03-22T01:20:18.988 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-03-22T01:20:22.766 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-22T01:20:22.875 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on
2024-03-22T01:20:22.976 INFO:teuthology.orchestra.console.smithi135:Power on completed
2024-03-22T01:20:23.077 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2024-03-22T01:23:04.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:04.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:07.938 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:23:07.939 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:23:08.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:11.902 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-03-22T01:23:13.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:13.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:17.022 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:23:17.023 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:23:17.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:20.958 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-03-22T01:23:23.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:23.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:26.078 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:23:26.079 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:23:26.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:30.014 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-03-22T01:23:32.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:32.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:35.134 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:23:35.135 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:23:36.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:39.070 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-03-22T01:23:41.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:41.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:44.194 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:23:44.195 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:23:45.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:48.126 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-03-22T01:23:50.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:50.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:53.278 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:23:53.279 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:23:54.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:57.186 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135
2024-03-22T01:23:59.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:23:59.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:02.334 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-03-22T01:24:02.335 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:24:03.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:08.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:08.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:11.422 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:24:17.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:35.998 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:24:42.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:45.058 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204
2024-03-22T01:24:51.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:24:53.010 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-22T01:24:53.010 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-22T01:25:03.192 WARNING:teuthology.provision.fog.smithi135:timed out
2024-03-22T01:25:08.342 WARNING:teuthology.provision.fog.smithi142:timed out
2024-03-22T01:25:09.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:25:09.495 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-22T01:25:09.495 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-22T01:25:09.724 INFO:teuthology.provision.fog.smithi135:Node is ready
2024-03-22T01:25:09.724 DEBUG:teuthology.orchestra.run.smithi135:> hostname
2024-03-22T01:25:09.783 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com
2024-03-22T01:25:09.783 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts
2024-03-22T01:25:09.842 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135
2024-03-22T01:25:09.842 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135
2024-03-22T01:25:09.939 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts
2024-03-22T01:25:09.967 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts
2024-03-22T01:25:10.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname
2024-03-22T01:25:10.102 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135
2024-03-22T01:25:10.170 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release
2024-03-22T01:25:10.229 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream"
2024-03-22T01:25:10.229 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8"
2024-03-22T01:25:10.229 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-22T01:25:10.230 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T01:25:10.231 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2024-03-22T01:25:10.233 DEBUG:teuthology.parallel:result is None
2024-03-22T01:25:14.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:25:14.576 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-22T01:25:14.577 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-22T01:25:14.846 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-03-22T01:25:14.846 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-03-22T01:25:14.865 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2024-03-22T01:25:14.866 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2024-03-22T01:25:14.926 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-03-22T01:25:14.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-03-22T01:25:15.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2024-03-22T01:25:15.058 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-03-22T01:25:15.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2024-03-22T01:25:15.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-03-22T01:25:15.263 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-03-22T01:25:15.321 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T01:25:15.322 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-22T01:25:15.322 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T01:25:15.322 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2024-03-22T01:25:15.323 DEBUG:teuthology.parallel:result is None
2024-03-22T01:25:18.771 INFO:teuthology.provision.fog.smithi204:Node is ready
2024-03-22T01:25:18.771 DEBUG:teuthology.orchestra.run.smithi204:> hostname
2024-03-22T01:25:18.795 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2024-03-22T01:25:18.795 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts
2024-03-22T01:25:18.856 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2024-03-22T01:25:18.856 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2024-03-22T01:25:18.987 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts
2024-03-22T01:25:19.018 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts
2024-03-22T01:25:19.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname
2024-03-22T01:25:19.157 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204
2024-03-22T01:25:19.224 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2024-03-22T01:25:19.282 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream"
2024-03-22T01:25:19.282 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8"
2024-03-22T01:25:19.282 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2024-03-22T01:25:19.282 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-22T01:25:19.283 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T01:25:19.283 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2024-03-22T01:25:19.284 DEBUG:teuthology.parallel:result is None
2024-03-22T01:25:19.476 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2024-03-22T01:25:19.476 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-22T01:25:19.498 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2024-03-22T01:25:19.498 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-22T01:25:19.514 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2024-03-22T01:25:19.514 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-22T01:25:19.532 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2024-03-22T01:25:19.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com'
2024-03-22T01:25:19.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:25:19.605 DEBUG:teuthology.orchestra.run.smithi135:> true
2024-03-22T01:25:19.676 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com'
2024-03-22T01:25:19.676 DEBUG:teuthology.orchestra.run.smithi135:> uname -m
2024-03-22T01:25:19.737 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2024-03-22T01:25:19.737 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-22T01:25:19.798 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/"
2024-03-22T01:25:19.799 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T01:25:19.799 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-22T01:25:19.799 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T01:25:19.799 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2024-03-22T01:25:19.823 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2024-03-22T01:25:19.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-03-22T01:25:19.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:25:19.896 DEBUG:teuthology.orchestra.run.smithi142:> true
2024-03-22T01:25:19.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-03-22T01:25:19.976 DEBUG:teuthology.orchestra.run.smithi142:> uname -m
2024-03-22T01:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2024-03-22T01:25:20.035 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-03-22T01:25:20.096 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T01:25:20.097 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-22T01:25:20.097 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T01:25:20.097 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-03-22T01:25:20.114 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2024-03-22T01:25:20.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2024-03-22T01:25:20.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-22T01:25:20.190 DEBUG:teuthology.orchestra.run.smithi204:> true
2024-03-22T01:25:20.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com'
2024-03-22T01:25:20.263 DEBUG:teuthology.orchestra.run.smithi204:> uname -m
2024-03-22T01:25:20.324 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2024-03-22T01:25:20.324 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release
2024-03-22T01:25:20.386 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream"
2024-03-22T01:25:20.386 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8"
2024-03-22T01:25:20.386 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2024-03-22T01:25:20.386 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2024-03-22T01:25:20.387 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-22T01:25:20.388 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-22T01:25:20.388 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-22T01:25:20.388 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2024-03-22T01:25:20.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:25:20.516 INFO:teuthology.dispatcher.supervisor:Running job 7615741
2024-03-22T01:25:20.516 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi/7615741 --name pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi/7615741/orig.config.yaml
2024-03-22T01:25:20.520 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-22_01:06:30-fs-wip-batrick-testing-20240321.172515-distro-default-smithi/7615741
2024-03-22T01:25:20.520 INFO:teuthology.dispatcher.supervisor:Job PID: 949950
2024-03-22T01:25:20.520 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-22T01:27:20.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:29:20.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:31:20.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:33:21.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:35:21.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:37:21.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:39:21.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:41:21.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:43:21.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:45:22.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:47:22.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:49:22.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:51:22.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-22T01:51:22.677 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1