2023-08-07T19:30:34.803 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5
2023-08-07T19:30:34.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:30:34.969 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4d419a5790>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4d40ecaee0>, signals=[15])
2023-08-07T19:30:34.971 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging
2023-08-07T19:30:34.972 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server
2023-08-07T19:30:34.972 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-08-07T19:30:35.005 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-08-07T19:30:35.005 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-08-07T19:30:35.005 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-08-07T19:30:35.006 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"}
2023-08-07T19:30:35.029 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-08-07T19:30:35.082 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-07T19:30:35.093 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-07T19:30:35.124 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-07T19:30:35.124 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 5}
2023-08-07T19:30:35.133 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-07T19:30:35.133 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5}
2023-08-07T19:30:35.163 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6
2023-08-07T19:30:35.163 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:30:35.186 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6
2023-08-07T19:30:35.186 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:30:35.200 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"}
2023-08-07T19:30:35.228 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-08-07T19:30:35.235 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1}
2023-08-07T19:30:35.258 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-08-07T19:30:35.294 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:30:35.343 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:30:35.382 INFO:teuthology.orchestra.console.smithi139:Power off
2023-08-07T19:30:35.383 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-07T19:30:35.407 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off
2023-08-07T19:30:35.407 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:35.424 INFO:teuthology.orchestra.console.smithi169:Power off
2023-08-07T19:30:35.425 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-07T19:30:35.435 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2023-08-07T19:30:35.449 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-08-07T19:30:35.450 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:35.501 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-07T19:30:39.440 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:39.503 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:39.554 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2023-08-07T19:30:39.614 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-07T19:30:43.557 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:43.615 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:43.667 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-08-07T19:30:43.727 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-07T19:30:43.768 INFO:teuthology.orchestra.console.smithi139:Power off completed
2023-08-07T19:30:43.869 INFO:teuthology.orchestra.console.smithi139:Power on
2023-08-07T19:30:43.870 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-07T19:30:43.892 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On
2023-08-07T19:30:43.892 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:43.914 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-08-07T19:30:47.728 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:47.839 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-07T19:30:47.915 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:47.940 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-08-07T19:30:48.024 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-08-07T19:30:48.041 INFO:teuthology.orchestra.console.smithi169:Power on
2023-08-07T19:30:48.042 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-07T19:30:48.066 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2023-08-07T19:30:48.067 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:48.089 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-07T19:30:52.030 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:52.090 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:52.141 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2023-08-07T19:30:52.201 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-07T19:30:52.242 INFO:teuthology.orchestra.console.smithi139:Power on completed
2023-08-07T19:30:52.343 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish
2023-08-07T19:30:52.344 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:30:56.205 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:30:56.315 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-07T19:30:56.416 INFO:teuthology.orchestra.console.smithi169:Power on completed
2023-08-07T19:30:56.517 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-08-07T19:30:56.518 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:31:07.404 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:31:11.568 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:31:22.472 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:31:26.616 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:31:37.532 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:31:41.668 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:31:52.588 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:31:56.728 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:32:07.648 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:32:11.776 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:32:22.705 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:32:26.836 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:32:37.768 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:32:41.888 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:32:52.840 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:32:56.952 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:33:07.908 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:33:12.032 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:33:22.984 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:33:27.115 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:33:38.062 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None
2023-08-07T19:33:38.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:33:41.200 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:33:42.174 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-07T19:33:42.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:33:45.300 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:33:47.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:33:50.256 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:33:51.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:33:54.352 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:33:56.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:33:59.312 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:34:00.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:03.408 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:34:05.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:08.372 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:34:09.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:12.464 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:34:14.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:17.460 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:34:18.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:21.520 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:34:23.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:26.512 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:34:27.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:30.576 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:34:32.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:36.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:39.632 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-07T19:34:45.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:34:50.992 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:34:56.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:35:00.048 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2023-08-07T19:35:06.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:35:07.379 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-07T19:35:07.380 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-07T19:35:07.826 INFO:teuthology.provision.fog.smithi139:Node is ready
2023-08-07T19:35:07.826 DEBUG:teuthology.orchestra.run.smithi139:> hostname
2023-08-07T19:35:07.842 INFO:teuthology.orchestra.run.smithi139.stdout:smithi022
2023-08-07T19:35:07.842 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi022 /etc/hosts
2023-08-07T19:35:07.898 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-08-07T19:35:07.898 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139
2023-08-07T19:35:08.068 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi022/smithi139/g' /etc/hosts
2023-08-07T19:35:08.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.22/172.21.15.139/g' /etc/hosts
2023-08-07T19:35:08.161 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi022/smithi139/g' /etc/hostname
2023-08-07T19:35:08.235 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139
2023-08-07T19:35:08.301 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release
2023-08-07T19:35:08.357 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux"
2023-08-07T19:35:08.357 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)"
2023-08-07T19:35:08.357 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel"
2023-08-07T19:35:08.357 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora"
2023-08-07T19:35:08.357 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6"
2023-08-07T19:35:08.358 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8"
2023-08-07T19:35:08.358 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-07T19:35:08.358 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2023-08-07T19:35:08.358 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-07T19:35:08.358 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/"
2023-08-07T19:35:08.358 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-07T19:35:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-07T19:35:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:
2023-08-07T19:35:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-07T19:35:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-07T19:35:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-07T19:35:08.359 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-07T19:35:08.360 INFO:teuthology.provision.fog.smithi139:Deploy complete!
2023-08-07T19:35:08.361 DEBUG:teuthology.parallel:result is None
2023-08-07T19:35:45.674 WARNING:teuthology.provision.fog.smithi169:timed out
2023-08-07T19:35:51.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:35:52.018 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-07T19:35:52.019 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-07T19:35:52.313 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-08-07T19:35:52.313 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-08-07T19:35:52.331 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2023-08-07T19:35:52.332 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2023-08-07T19:35:52.390 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2023-08-07T19:35:52.390 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-08-07T19:35:52.516 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2023-08-07T19:35:52.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2023-08-07T19:35:52.612 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2023-08-07T19:35:52.680 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-08-07T19:35:52.746 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-08-07T19:35:52.801 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux"
2023-08-07T19:35:52.802 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)"
2023-08-07T19:35:52.802 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel"
2023-08-07T19:35:52.802 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora"
2023-08-07T19:35:52.802 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6"
2023-08-07T19:35:52.802 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:
2023-08-07T19:35:52.803 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-07T19:35:52.804 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-07T19:35:52.804 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-07T19:35:52.804 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-07T19:35:52.804 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-08-07T19:35:52.805 DEBUG:teuthology.parallel:result is None
2023-08-07T19:35:52.947 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com
2023-08-07T19:35:52.948 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-07T19:35:52.982 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2023-08-07T19:35:52.983 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-07T19:35:53.000 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server
2023-08-07T19:35:53.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-08-07T19:35:53.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:35:53.069 DEBUG:teuthology.orchestra.run.smithi139:> true
2023-08-07T19:35:53.206 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com'
2023-08-07T19:35:53.206 DEBUG:teuthology.orchestra.run.smithi139:> uname -m
2023-08-07T19:35:53.264 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64
2023-08-07T19:35:53.265 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release
2023-08-07T19:35:53.321 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux"
2023-08-07T19:35:53.321 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2023-08-07T19:35:53.322 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/"
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-07T19:35:53.323 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-07T19:35:53.324 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-07T19:35:53.324 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2023-08-07T19:35:53.349 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2023-08-07T19:35:53.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-07T19:35:53.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-07T19:35:53.416 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-08-07T19:35:53.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-07T19:35:53.482 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2023-08-07T19:35:53.539 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2023-08-07T19:35:53.539 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-08-07T19:35:53.595 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Red Hat Enterprise Linux"
2023-08-07T19:35:53.595 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8.6 (Ootpa)"
2023-08-07T19:35:53.595 INFO:teuthology.orchestra.run.smithi169.stdout:ID="rhel"
2023-08-07T19:35:53.595 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="fedora"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8.6"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.redhat.com/"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-07T19:35:53.596 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-07T19:35:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:
2023-08-07T19:35:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-07T19:35:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-07T19:35:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-07T19:35:53.597 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-07T19:35:53.598 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-08-07T19:35:53.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:35:53.725 INFO:teuthology.dispatcher.supervisor:Running job 7360680
2023-08-07T19:35:53.725 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ce5f6d589a888dfc88977261bfa1ed63441de8fb/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360680 --name rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}} -- /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360680/orig.config.yaml
2023-08-07T19:35:53.731 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360680
2023-08-07T19:35:53.732 INFO:teuthology.dispatcher.supervisor:Job PID: 22087
2023-08-07T19:35:53.732 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-07T19:37:53.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:39:54.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:41:54.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:43:54.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:45:54.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-07T19:45:54.579 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-07T19:45:54.737 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-07T19:45:54.738 INFO:teuthology.nuke:Checking targets against current locks
2023-08-07T19:45:54.785 DEBUG:teuthology.nuke:shortname: smithi139
2023-08-07T19:45:54.786 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-07T19:45:54.806 DEBUG:teuthology.nuke:shortname: smithi169
2023-08-07T19:45:54.807 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-07T19:45:54.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 19:30:33.977284', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-08-07T19:45:54.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 19:30:33.978630', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-08-07T19:45:54.858 INFO:teuthology.orchestra.console.smithi139:Power off
2023-08-07T19:45:54.858 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-07T19:45:54.881 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off
2023-08-07T19:45:54.882 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:45:54.898 INFO:teuthology.orchestra.console.smithi169:Power off
2023-08-07T19:45:54.899 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-07T19:45:54.911 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2023-08-07T19:45:54.922 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-08-07T19:45:54.923 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-07T19:45:54.944 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-07T19:45:55.012 INFO:teuthology.orchestra.console.smithi139:Power off completed
2023-08-07T19:45:55.046 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-08-07T19:45:55.162 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com
2023-08-07T19:45:55.187 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com