2024-02-20T20:06:42.798 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-20T20:06:42.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:06:42.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f428d8b6f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f428e92ac10>, signals=[15])
2024-02-20T20:06:42.988 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2024-02-20T20:06:42.988 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T20:06:42.988 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2024-02-20T20:06:43.010 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging
2024-02-20T20:06:43.011 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T20:06:43.011 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2024-02-20T20:06:43.035 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging
2024-02-20T20:06:43.035 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server
2024-02-20T20:06:43.035 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-02-20T20:06:43.135 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-20T20:06:43.152 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-20T20:06:43.194 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6
2024-02-20T20:06:43.197 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_rhel_8.6 (ID 5)
2024-02-20T20:06:43.200 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.6
2024-02-20T20:06:43.242 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.6
2024-02-20T20:06:43.443 INFO:teuthology.orchestra.console.smithi033:Power off
2024-02-20T20:06:43.443 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T20:06:43.466 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2024-02-20T20:06:43.467 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:43.484 INFO:teuthology.orchestra.console.smithi053:Power off
2024-02-20T20:06:43.484 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T20:06:43.498 INFO:teuthology.orchestra.console.smithi063:Power off
2024-02-20T20:06:43.499 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-20T20:06:43.507 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-02-20T20:06:43.508 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off
2024-02-20T20:06:43.509 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:43.522 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off
2024-02-20T20:06:43.522 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:43.531 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-02-20T20:06:43.547 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-02-20T20:06:47.512 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:47.532 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:47.548 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:47.621 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-02-20T20:06:47.641 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-02-20T20:06:47.657 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-02-20T20:06:51.624 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:51.642 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:51.657 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:51.734 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-02-20T20:06:51.750 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-02-20T20:06:51.766 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-02-20T20:06:51.851 INFO:teuthology.orchestra.console.smithi053:Power off completed
2024-02-20T20:06:51.952 INFO:teuthology.orchestra.console.smithi053:Power on
2024-02-20T20:06:51.952 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T20:06:51.977 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On
2024-02-20T20:06:51.977 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:52.001 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off
2024-02-20T20:06:55.736 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:55.766 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:55.846 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2024-02-20T20:06:55.877 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-02-20T20:06:55.947 INFO:teuthology.orchestra.console.smithi033:Power off completed
2024-02-20T20:06:55.978 INFO:teuthology.orchestra.console.smithi063:Power off completed
2024-02-20T20:06:56.002 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:56.049 INFO:teuthology.orchestra.console.smithi033:Power on
2024-02-20T20:06:56.049 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T20:06:56.070 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On
2024-02-20T20:06:56.070 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:56.079 INFO:teuthology.orchestra.console.smithi063:Power on
2024-02-20T20:06:56.079 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-20T20:06:56.092 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2024-02-20T20:06:56.098 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On
2024-02-20T20:06:56.099 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:06:56.111 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on
2024-02-20T20:06:56.126 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off
2024-02-20T20:06:56.213 INFO:teuthology.orchestra.console.smithi053:Power on completed
2024-02-20T20:06:56.313 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish
2024-02-20T20:07:00.095 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:07:00.127 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-20T20:07:00.205 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2024-02-20T20:07:00.235 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on
2024-02-20T20:07:00.306 INFO:teuthology.orchestra.console.smithi033:Power on completed
2024-02-20T20:07:00.336 INFO:teuthology.orchestra.console.smithi063:Power on completed
2024-02-20T20:07:00.407 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2024-02-20T20:07:00.436 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2024-02-20T20:09:27.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:30.144 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-02-20T20:09:31.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:34.172 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:09:36.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:39.232 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-02-20T20:09:40.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:43.228 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:09:45.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:46.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:48.316 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-02-20T20:09:49.216 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:09:49.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:52.284 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:09:54.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:55.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:57.372 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53
2024-02-20T20:09:58.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:09:58.300 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:10:01.340 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:10:03.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:04.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:07.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:07.359 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:10:10.400 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:10:13.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:16.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:16.412 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:10:22.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:25.468 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:10:31.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:34.524 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:10:34.944 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:10:40.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:40.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:43.584 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63
2024-02-20T20:10:43.996 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2024-02-20T20:10:49.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:49.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:10:53.076 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T20:10:53.076 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T20:11:03.376 WARNING:teuthology.provision.fog.smithi053:timed out
2024-02-20T20:11:08.226 INFO:teuthology.provision.fog.smithi033:Node is ready
2024-02-20T20:11:08.226 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2024-02-20T20:11:08.249 INFO:teuthology.orchestra.run.smithi033.stdout:smithi045
2024-02-20T20:11:08.250 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi045 /etc/hosts
2024-02-20T20:11:08.311 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-02-20T20:11:08.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi045/smithi033/g' /etc/hostname
2024-02-20T20:11:08.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2024-02-20T20:11:08.496 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2024-02-20T20:11:08.557 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T20:11:08.558 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T20:11:08.559 INFO:teuthology.orchestra.run.smithi033.stdout:
2024-02-20T20:11:08.559 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T20:11:08.559 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T20:11:08.559 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T20:11:08.559 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T20:11:08.560 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2024-02-20T20:11:08.561 DEBUG:teuthology.parallel:result is None
2024-02-20T20:11:09.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:11:09.621 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T20:11:09.622 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T20:11:09.884 INFO:teuthology.provision.fog.smithi053:Node is ready
2024-02-20T20:11:09.884 DEBUG:teuthology.orchestra.run.smithi053:> hostname
2024-02-20T20:11:09.905 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com
2024-02-20T20:11:09.905 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts
2024-02-20T20:11:09.966 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053
2024-02-20T20:11:09.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2024-02-20T20:11:10.092 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts
2024-02-20T20:11:10.126 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts
2024-02-20T20:11:10.201 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname
2024-02-20T20:11:10.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053
2024-02-20T20:11:10.352 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2024-02-20T20:11:10.414 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T20:11:10.415 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T20:11:10.415 INFO:teuthology.provision.fog.smithi053:Deploy complete!
2024-02-20T20:11:10.416 DEBUG:teuthology.parallel:result is None
2024-02-20T20:11:49.630 WARNING:teuthology.provision.fog.smithi063:timed out
2024-02-20T20:11:55.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:11:55.903 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-20T20:11:55.904 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-20T20:11:56.137 INFO:teuthology.provision.fog.smithi063:Node is ready
2024-02-20T20:11:56.138 DEBUG:teuthology.orchestra.run.smithi063:> hostname
2024-02-20T20:11:56.197 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2024-02-20T20:11:56.197 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi063.front.sepia.ceph.com /etc/hosts
2024-02-20T20:11:56.256 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2024-02-20T20:11:56.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-02-20T20:11:56.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hosts
2024-02-20T20:11:56.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.63/172.21.15.63/g' /etc/hosts
2024-02-20T20:11:56.476 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi063.front.sepia.ceph.com/smithi063/g' /etc/hostname
2024-02-20T20:11:56.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063
2024-02-20T20:11:56.614 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-02-20T20:11:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T20:11:56.674 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T20:11:56.674 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2024-02-20T20:11:56.675 DEBUG:teuthology.parallel:result is None
2024-02-20T20:11:56.874 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2024-02-20T20:11:56.874 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T20:11:56.908 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com
2024-02-20T20:11:56.908 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T20:11:56.924 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2024-02-20T20:11:56.924 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-20T20:11:56.942 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2024-02-20T20:11:56.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2024-02-20T20:11:56.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:11:57.022 DEBUG:teuthology.orchestra.run.smithi033:> true
2024-02-20T20:11:57.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com'
2024-02-20T20:11:57.172 DEBUG:teuthology.orchestra.run.smithi033:> uname -m
2024-02-20T20:11:57.233 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2024-02-20T20:11:57.233 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2024-02-20T20:11:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T20:11:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T20:11:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:
2024-02-20T20:11:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T20:11:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T20:11:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T20:11:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T20:11:57.296 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2024-02-20T20:11:57.316 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server
2024-02-20T20:11:57.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com'
2024-02-20T20:11:57.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:11:57.390 DEBUG:teuthology.orchestra.run.smithi053:> true
2024-02-20T20:11:57.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com'
2024-02-20T20:11:57.537 DEBUG:teuthology.orchestra.run.smithi053:> uname -m
2024-02-20T20:11:57.598 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64
2024-02-20T20:11:57.599 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release
2024-02-20T20:11:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T20:11:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T20:11:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel"
2024-02-20T20:11:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora"
2024-02-20T20:11:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6"
2024-02-20T20:11:57.660 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T20:11:57.661 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T20:11:57.662 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server
2024-02-20T20:11:57.683 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2024-02-20T20:11:57.683 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-02-20T20:11:57.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-20T20:11:57.759 DEBUG:teuthology.orchestra.run.smithi063:> true
2024-02-20T20:11:57.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com'
2024-02-20T20:11:57.832 DEBUG:teuthology.orchestra.run.smithi063:> uname -m
2024-02-20T20:11:57.891 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2024-02-20T20:11:57.892 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release
2024-02-20T20:11:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2024-02-20T20:11:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)"
2024-02-20T20:11:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2024-02-20T20:11:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2024-02-20T20:11:57.952 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-02-20T20:11:57.953 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-02-20T20:11:57.954 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2024-02-20T20:11:57.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:11:58.079 INFO:teuthology.dispatcher.supervisor:Running job 7568343
2024-02-20T20:11:58.079 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-20_04:32:05-fs-wip-vshankar-testing1-reef-2024-02-19-2138-testing-default-smithi/7568343 --name vshankar-2024-02-20_04:32:05-fs-wip-vshankar-testing1-reef-2024-02-19-2138-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/vshankar-2024-02-20_04:32:05-fs-wip-vshankar-testing1-reef-2024-02-19-2138-testing-default-smithi/7568343/orig.config.yaml
2024-02-20T20:11:58.083 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-20_04:32:05-fs-wip-vshankar-testing1-reef-2024-02-19-2138-testing-default-smithi/7568343
2024-02-20T20:11:58.083 INFO:teuthology.dispatcher.supervisor:Job PID: 2298895
2024-02-20T20:11:58.083 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-20T20:13:58.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:15:58.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:17:58.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:19:58.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:21:58.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:23:59.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:25:59.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:27:59.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:29:59.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:31:59.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:34:00.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:36:00.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:38:00.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-20T20:38:00.419 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1