2023-12-07T09:44:40.050 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-07T09:44:40.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:44:40.237 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f58971f7400>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5896d37e50>, signals=[15])
2023-12-07T09:44:40.237 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-12-07T09:44:40.238 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T09:44:40.238 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-12-07T09:44:40.265 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2023-12-07T09:44:40.266 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T09:44:40.266 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-12-07T09:44:40.290 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-12-07T09:44:40.290 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-12-07T09:44:40.290 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-12-07T09:44:40.401 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-07T09:44:40.414 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-07T09:44:40.444 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-07T09:44:40.456 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.6
2023-12-07T09:44:40.459 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6
2023-12-07T09:44:40.492 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.6
2023-12-07T09:44:40.695 INFO:teuthology.orchestra.console.smithi153:Power off
2023-12-07T09:44:40.696 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T09:44:40.716 INFO:teuthology.orchestra.console.smithi119:Power off
2023-12-07T09:44:40.717 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T09:44:40.732 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2023-12-07T09:44:40.732 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:40.746 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-12-07T09:44:40.747 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:40.764 INFO:teuthology.orchestra.console.smithi159:Power off
2023-12-07T09:44:40.765 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T09:44:40.784 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-12-07T09:44:40.785 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2023-12-07T09:44:40.806 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-12-07T09:44:40.806 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:40.833 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-12-07T09:44:44.786 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:44.795 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:44.833 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:44.897 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-12-07T09:44:44.906 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2023-12-07T09:44:44.945 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-12-07T09:44:48.902 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:48.914 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:48.945 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:49.016 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-12-07T09:44:49.026 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-12-07T09:44:49.058 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-12-07T09:44:49.118 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-12-07T09:44:49.127 INFO:teuthology.orchestra.console.smithi153:Power off completed
2023-12-07T09:44:49.219 INFO:teuthology.orchestra.console.smithi119:Power on
2023-12-07T09:44:49.219 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T09:44:49.229 INFO:teuthology.orchestra.console.smithi153:Power on
2023-12-07T09:44:49.229 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T09:44:49.244 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2023-12-07T09:44:49.245 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:49.255 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On
2023-12-07T09:44:49.255 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:49.268 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-12-07T09:44:49.279 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-12-07T09:44:53.062 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:53.171 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-07T09:44:53.270 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:53.280 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-12-07T09:44:53.280 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:53.381 INFO:teuthology.orchestra.console.smithi159:Power on
2023-12-07T09:44:53.381 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-07T09:44:53.391 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-12-07T09:44:53.399 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-12-07T09:44:53.407 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2023-12-07T09:44:53.407 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:53.434 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-07T09:44:57.395 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:57.405 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:57.435 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:44:57.510 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2023-12-07T09:44:57.514 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on
2023-12-07T09:44:57.544 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-07T09:44:57.611 INFO:teuthology.orchestra.console.smithi119:Power on completed
2023-12-07T09:44:57.615 INFO:teuthology.orchestra.console.smithi153:Power on completed
2023-12-07T09:44:57.715 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2023-12-07T09:44:57.719 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2023-12-07T09:45:01.547 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T09:45:01.658 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-12-07T09:45:01.758 INFO:teuthology.orchestra.console.smithi159:Power on completed
2023-12-07T09:45:01.859 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-12-07T09:47:43.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:47:43.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:47:46.690 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-12-07T09:47:46.691 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:47:47.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:47:50.722 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:47:52.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:47:52.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:47:55.750 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-12-07T09:47:55.751 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:47:56.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:47:59.782 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:01.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:01.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:04.838 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-12-07T09:48:04.839 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:48:05.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:08.834 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:10.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:10.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:13.926 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-12-07T09:48:13.927 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:48:14.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:17.894 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:19.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:19.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:23.010 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-12-07T09:48:23.011 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:48:23.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:26.978 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:29.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:29.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:32.066 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:48:32.070 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-12-07T09:48:32.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:36.034 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:38.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:38.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:41.122 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:48:42.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:45.094 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:47.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:50.178 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-12-07T09:48:51.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:48:54.150 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-12-07T09:48:56.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:49:00.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:49:38.110 WARNING:teuthology.provision.fog.smithi119:timed out
2023-12-07T09:49:44.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:49:44.689 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T09:49:44.690 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T09:49:44.963 INFO:teuthology.provision.fog.smithi119:Node is ready
2023-12-07T09:49:44.963 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2023-12-07T09:49:45.021 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119
2023-12-07T09:49:45.022 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119 /etc/hosts
2023-12-07T09:49:45.079 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2023-12-07T09:49:45.080 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-12-07T09:49:45.212 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hosts
2023-12-07T09:49:45.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2023-12-07T09:49:45.308 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hostname
2023-12-07T09:49:45.376 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-12-07T09:49:45.443 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-12-07T09:49:45.499 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T09:49:45.499 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T09:49:45.499 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T09:49:45.500 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T09:49:45.501 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T09:49:45.501 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2023-12-07T09:49:45.504 DEBUG:teuthology.parallel:result is None
2023-12-07T09:49:56.194 WARNING:teuthology.provision.fog.smithi153:timed out
2023-12-07T09:50:00.158 WARNING:teuthology.provision.fog.smithi159:timed out
2023-12-07T09:50:02.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:50:02.568 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T09:50:02.569 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T09:50:02.867 INFO:teuthology.provision.fog.smithi153:Node is ready
2023-12-07T09:50:02.867 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2023-12-07T09:50:02.884 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153
2023-12-07T09:50:02.885 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153 /etc/hosts
2023-12-07T09:50:02.945 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2023-12-07T09:50:02.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-12-07T09:50:03.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153/smithi153/g' /etc/hosts
2023-12-07T09:50:03.079 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2023-12-07T09:50:03.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153/smithi153/g' /etc/hostname
2023-12-07T09:50:03.222 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-12-07T09:50:03.292 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-12-07T09:50:03.352 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T09:50:03.352 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T09:50:03.352 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2023-12-07T09:50:03.352 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T09:50:03.353 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T09:50:03.354 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T09:50:03.354 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2023-12-07T09:50:03.354 DEBUG:teuthology.parallel:result is None
2023-12-07T09:50:06.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:50:06.564 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-07T09:50:06.565 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-07T09:50:06.819 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-12-07T09:50:06.819 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-12-07T09:50:06.878 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-12-07T09:50:06.878 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-12-07T09:50:06.936 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-12-07T09:50:06.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-12-07T09:50:07.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-12-07T09:50:07.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-12-07T09:50:07.159 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-12-07T09:50:07.226 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-12-07T09:50:07.481 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-12-07T09:50:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T09:50:07.542 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T09:50:07.543 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T09:50:07.543 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-12-07T09:50:07.543 DEBUG:teuthology.parallel:result is None
2023-12-07T09:50:07.745 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2023-12-07T09:50:07.745 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T09:50:07.770 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2023-12-07T09:50:07.770 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T09:50:07.786 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-12-07T09:50:07.787 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-07T09:50:07.804 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2023-12-07T09:50:07.805 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-12-07T09:50:07.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:50:07.874 DEBUG:teuthology.orchestra.run.smithi119:> true
2023-12-07T09:50:08.007 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-12-07T09:50:08.008 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2023-12-07T09:50:08.065 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2023-12-07T09:50:08.066 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T09:50:08.123 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T09:50:08.124 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-12-07T09:50:08.124 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T09:50:08.124 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T09:50:08.124 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T09:50:08.124 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T09:50:08.124 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-12-07T09:50:08.145 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2023-12-07T09:50:08.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-12-07T09:50:08.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:50:08.213 DEBUG:teuthology.orchestra.run.smithi153:> true
2023-12-07T09:50:08.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-12-07T09:50:08.282 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2023-12-07T09:50:08.340 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2023-12-07T09:50:08.340 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-12-07T09:50:08.398 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T09:50:08.399 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T09:50:08.400 INFO:teuthology.orchestra.run.smithi153.stdout:
2023-12-07T09:50:08.400 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T09:50:08.400 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T09:50:08.400 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T09:50:08.400 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T09:50:08.400 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-12-07T09:50:08.420 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-12-07T09:50:08.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-12-07T09:50:08.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-07T09:50:08.486 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-12-07T09:50:08.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-12-07T09:50:08.510 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-12-07T09:50:08.567 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-12-07T09:50:08.568 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-12-07T09:50:08.624 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2023-12-07T09:50:08.625 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2023-12-07T09:50:08.625 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2023-12-07T09:50:08.625 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2023-12-07T09:50:08.625 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2023-12-07T09:50:08.625 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-07T09:50:08.626 INFO:teuthology.orchestra.run.smithi159.stdout:
2023-12-07T09:50:08.627 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-07T09:50:08.627 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-07T09:50:08.627 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-07T09:50:08.627 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-07T09:50:08.628 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-12-07T09:50:08.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:50:08.742 INFO:teuthology.dispatcher.supervisor:Running job 7481878
2023-12-07T09:50:08.742 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481878 --name vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481878/orig.config.yaml
2023-12-07T09:50:08.746 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481878
2023-12-07T09:50:08.747 INFO:teuthology.dispatcher.supervisor:Job PID: 2256
2023-12-07T09:50:08.747 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-07T09:52:08.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:54:09.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:56:09.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T09:58:09.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:00:09.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:02:09.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:04:09.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:06:10.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:08:10.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:10:10.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:12:10.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:14:10.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:16:10.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:18:11.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:20:11.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:22:11.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:24:11.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:26:11.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:28:11.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:30:12.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:32:12.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:34:12.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:36:12.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:38:12.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:40:12.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:42:13.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:44:13.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-07T10:44:13.306 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-07T10:44:13.791 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-07T10:44:13.791 INFO:teuthology.nuke:Checking targets against current locks
2023-12-07T10:44:13.838 DEBUG:teuthology.nuke:shortname: smithi119
2023-12-07T10:44:13.838 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T10:44:13.868 DEBUG:teuthology.nuke:shortname: smithi153
2023-12-07T10:44:13.868 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T10:44:13.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:44:39.115502', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-07T10:44:13.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:44:39.117617', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-07T10:44:13.897 DEBUG:teuthology.nuke:shortname: smithi159
2023-12-07T10:44:13.897 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-07T10:44:13.928 INFO:teuthology.orchestra.console.smithi119:Power off
2023-12-07T10:44:13.929 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T10:44:13.936 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-07_09:28:49-fs-wip-vshankar-testing-20231127.102654-r2-distro-default-smithi/7481878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 09:44:39.116665', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-07T10:44:13.949 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2023-12-07T10:44:13.949 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T10:44:13.965 INFO:teuthology.orchestra.console.smithi153:Power off
2023-12-07T10:44:13.966 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T10:44:13.977 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2023-12-07T10:44:13.986 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off
2023-12-07T10:44:13.986 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T10:44:14.003 INFO:teuthology.orchestra.console.smithi159:Power off
2023-12-07T10:44:14.003 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-07T10:44:14.012 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off
2023-12-07T10:44:14.024 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-12-07T10:44:14.025 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-07T10:44:14.047 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-12-07T10:44:14.078 INFO:teuthology.orchestra.console.smithi119:Power off completed
2023-12-07T10:44:14.113 INFO:teuthology.orchestra.console.smithi153:Power off completed
2023-12-07T10:44:14.147 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-12-07T10:44:14.229 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com
2023-12-07T10:44:14.270 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com
2023-12-07T10:44:14.296 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com