2023-12-25T06:43:33.837 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a
2023-12-25T06:43:33.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T06:43:33.993 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7feea8356310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7feea92b0940>, signals=[15])
2023-12-25T06:43:33.994 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-12-25T06:43:33.994 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-12-25T06:43:33.994 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-12-25T06:43:34.010 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2023-12-25T06:43:34.010 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2023-12-25T06:43:34.010 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-12-25T06:43:34.131 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-25T06:43:34.134 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-25T06:43:34.186 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.4
2023-12-25T06:43:34.190 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.4
2023-12-25T06:43:34.697 INFO:teuthology.orchestra.console.smithi123:Power off
2023-12-25T06:43:34.697 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-25T06:43:34.710 INFO:teuthology.orchestra.console.smithi177:Power off
2023-12-25T06:43:34.710 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-25T06:43:34.718 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-12-25T06:43:34.718 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:34.731 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2023-12-25T06:43:34.731 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:34.740 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-25T06:43:34.752 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2023-12-25T06:43:38.746 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:38.752 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:38.855 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-25T06:43:38.860 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2023-12-25T06:43:42.858 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:42.865 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:42.967 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-25T06:43:42.974 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2023-12-25T06:43:43.068 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-12-25T06:43:43.074 INFO:teuthology.orchestra.console.smithi177:Power off completed
2023-12-25T06:43:43.169 INFO:teuthology.orchestra.console.smithi123:Power on
2023-12-25T06:43:43.169 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-25T06:43:43.175 INFO:teuthology.orchestra.console.smithi177:Power on
2023-12-25T06:43:43.176 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-25T06:43:43.188 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2023-12-25T06:43:43.188 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:43.196 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On
2023-12-25T06:43:43.197 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:43.210 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-25T06:43:43.217 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2023-12-25T06:43:47.215 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:47.222 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:47.324 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2023-12-25T06:43:47.329 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2023-12-25T06:43:47.425 INFO:teuthology.orchestra.console.smithi123:Power on completed
2023-12-25T06:43:47.526 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-12-25T06:43:51.334 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T06:43:51.443 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on
2023-12-25T06:43:51.544 INFO:teuthology.orchestra.console.smithi177:Power on completed
2023-12-25T06:43:51.644 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2023-12-25T06:49:39.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:49:42.225 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:49:48.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:49:51.281 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:49:57.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:00.369 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:50:06.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:09.425 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:50:15.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:18.485 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:50:24.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:42.833 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:50:42.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:46.034 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:50:48.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:51.889 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:50:52.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:50:55.089 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:50:57.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:00.945 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-12-25T06:51:01.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:04.149 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:51:06.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:07.534 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-25T06:51:07.534 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-25T06:51:10.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:13.201 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:51:19.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:22.257 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:51:27.812 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-12-25T06:51:27.812 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2023-12-25T06:51:27.870 INFO:teuthology.orchestra.run.smithi123.stdout:smithi036
2023-12-25T06:51:27.870 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi036 /etc/hosts
2023-12-25T06:51:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036
2023-12-25T06:51:27.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-12-25T06:51:28.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi036/smithi123/g' /etc/hosts
2023-12-25T06:51:28.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.36/172.21.15.123/g' /etc/hosts
2023-12-25T06:51:28.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi036/smithi123/g' /etc/hostname
2023-12-25T06:51:28.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:28.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-12-25T06:51:28.361 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.4 (Ootpa)"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.4"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-25T06:51:28.416 INFO:teuthology.orchestra.run.smithi123.stdout:
2023-12-25T06:51:28.417 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-25T06:51:28.417 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-25T06:51:28.417 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-25T06:51:28.417 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-25T06:51:28.417 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2023-12-25T06:51:28.418 DEBUG:teuthology.parallel:result is None
2023-12-25T06:51:31.318 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:51:37.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:47.601 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:51:53.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:51:56.693 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:52:02.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:52:05.781 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-12-25T06:52:11.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:52:13.620 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-25T06:52:13.620 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-25T06:52:33.895 INFO:teuthology.provision.fog.smithi177:Node is ready
2023-12-25T06:52:33.895 DEBUG:teuthology.orchestra.run.smithi177:> hostname
2023-12-25T06:52:33.952 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com
2023-12-25T06:52:33.953 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts
2023-12-25T06:52:34.008 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177
2023-12-25T06:52:34.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2023-12-25T06:52:34.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts
2023-12-25T06:52:34.201 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts
2023-12-25T06:52:34.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname
2023-12-25T06:52:34.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177
2023-12-25T06:52:34.396 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2023-12-25T06:52:34.450 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.4 (Ootpa)"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.4"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:
2023-12-25T06:52:34.451 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-25T06:52:34.452 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-25T06:52:34.452 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-25T06:52:34.452 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-25T06:52:34.452 INFO:teuthology.provision.fog.smithi177:Deploy complete!
2023-12-25T06:52:34.453 DEBUG:teuthology.parallel:result is None
2023-12-25T06:52:34.610 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2023-12-25T06:52:34.611 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-25T06:52:34.643 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com
2023-12-25T06:52:34.644 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-25T06:52:34.661 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2023-12-25T06:52:34.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-12-25T06:52:34.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:52:34.731 DEBUG:teuthology.orchestra.run.smithi123:> true
2023-12-25T06:52:34.858 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com'
2023-12-25T06:52:34.859 DEBUG:teuthology.orchestra.run.smithi123:> uname -m
2023-12-25T06:52:34.915 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2023-12-25T06:52:34.915 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.4 (Ootpa)"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.4"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2023-12-25T06:52:34.971 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-25T06:52:34.972 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-25T06:52:34.972 INFO:teuthology.orchestra.run.smithi123.stdout:
2023-12-25T06:52:34.972 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-25T06:52:34.972 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-25T06:52:34.972 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-25T06:52:34.972 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-25T06:52:34.972 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-12-25T06:52:34.993 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server
2023-12-25T06:52:34.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-12-25T06:52:34.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-25T06:52:35.061 DEBUG:teuthology.orchestra.run.smithi177:> true
2023-12-25T06:52:35.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com'
2023-12-25T06:52:35.127 DEBUG:teuthology.orchestra.run.smithi177:> uname -m
2023-12-25T06:52:35.182 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64
2023-12-25T06:52:35.182 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release
2023-12-25T06:52:35.236 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Red Hat Enterprise Linux"
2023-12-25T06:52:35.236 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="8.4 (Ootpa)"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:ID="rhel"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="fedora"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="8.4"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el8"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.redhat.com/"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-25T06:52:35.237 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-25T06:52:35.238 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-25T06:52:35.238 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-12-25T06:52:35.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T06:52:35.351 INFO:teuthology.dispatcher.supervisor:Running job 7500569
2023-12-25T06:52:35.351 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500569 --name rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi --description fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500569/orig.config.yaml
2023-12-25T06:52:35.354 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500569
2023-12-25T06:52:35.354 INFO:teuthology.dispatcher.supervisor:Job PID: 3073267
2023-12-25T06:52:35.355 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-25T06:54:35.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T06:56:35.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T06:58:35.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T07:00:35.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T07:02:36.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-25T07:02:36.216 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-25T07:02:36.326 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-25T07:02:36.326 INFO:teuthology.nuke:Checking targets against current locks
2023-12-25T07:02:36.374 DEBUG:teuthology.nuke:shortname: smithi123
2023-12-25T07:02:36.374 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-25T07:02:36.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-25 06:43:33.027402', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFXnu5ES1ddX8dUo9ujf5sFXOCwhwAhtYW2NofIXZBOa4m/4EPRrC3dkyQClMyw58Dq3FamyHQsY9vbXR42SVHU='}
2023-12-25T07:02:36.397 DEBUG:teuthology.nuke:shortname: smithi177
2023-12-25T07:02:36.397 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-25T07:02:36.417 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-25_06:42:26-fs-rishabh-mdscap-pacific-testing-default-smithi/7500569', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-25 06:43:33.029763', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP2YNHrgK5i+T6X3setH98Vl/Z6eh65nnR5n0FTRkOOfM2e9au/byZu3VmicXRdUoKdTBJxlZCXd6djmZ3JP0/A='}
2023-12-25T07:02:36.438 INFO:teuthology.orchestra.console.smithi123:Power off
2023-12-25T07:02:36.438 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-25T07:02:36.467 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2023-12-25T07:02:36.467 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T07:02:36.483 INFO:teuthology.orchestra.console.smithi177:Power off
2023-12-25T07:02:36.484 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-25T07:02:36.493 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2023-12-25T07:02:36.507 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off
2023-12-25T07:02:36.508 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-25T07:02:36.532 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off
2023-12-25T07:02:36.594 INFO:teuthology.orchestra.console.smithi123:Power off completed
2023-12-25T07:02:36.637 INFO:teuthology.orchestra.console.smithi177:Power off completed
2023-12-25T07:02:36.749 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2023-12-25T07:02:36.782 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com