2023-11-16T17:55:16.173 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-16T17:55:16.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T17:55:16.326 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f62df078940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f62ded75ca0>, signals=[15])
2023-11-16T17:55:16.327 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging
2023-11-16T17:55:16.327 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server
2023-11-16T17:55:16.327 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-11-16T17:55:16.355 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-11-16T17:55:16.355 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-11-16T17:55:16.356 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-16T17:55:16.357 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"}
2023-11-16T17:55:16.371 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging
2023-11-16T17:55:16.371 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server
2023-11-16T17:55:16.371 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-11-16T17:55:16.372 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"}
2023-11-16T17:55:16.387 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"}
2023-11-16T17:55:16.422 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-16T17:55:16.449 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-16T17:55:16.452 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-16T17:55:16.463 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-16T17:55:16.463 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 5}
2023-11-16T17:55:16.492 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-16T17:55:16.492 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 5}
2023-11-16T17:55:16.501 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-16T17:55:16.501 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 5}
2023-11-16T17:55:16.504 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of rhel 8.6
2023-11-16T17:55:16.504 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:55:16.530 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6
2023-11-16T17:55:16.530 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:55:16.542 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of rhel 8.6
2023-11-16T17:55:16.542 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:55:16.553 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"}
2023-11-16T17:55:16.578 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"}
2023-11-16T17:55:16.587 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1}
2023-11-16T17:55:16.590 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"}
2023-11-16T17:55:16.614 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1}
2023-11-16T17:55:16.620 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1}
2023-11-16T17:55:16.680 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:55:16.692 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:55:16.694 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:55:16.768 INFO:teuthology.orchestra.console.smithi023:Power off
2023-11-16T17:55:16.769 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-16T17:55:16.782 INFO:teuthology.orchestra.console.smithi094:Power off
2023-11-16T17:55:16.782 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-16T17:55:16.793 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-16T17:55:16.794 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-16T17:55:16.803 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off
2023-11-16T17:55:16.803 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:16.810 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-11-16T17:55:16.810 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:16.818 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-16T17:55:16.818 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:16.832 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-11-16T17:55:16.838 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-16T17:55:16.843 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2023-11-16T17:55:20.837 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:20.843 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:20.850 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:20.946 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-11-16T17:55:20.952 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-16T17:55:20.957 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2023-11-16T17:55:24.950 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:24.956 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:24.962 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:25.058 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-16T17:55:25.064 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-16T17:55:25.070 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-16T17:55:25.159 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-11-16T17:55:25.171 INFO:teuthology.orchestra.console.smithi023:Power off completed
2023-11-16T17:55:25.260 INFO:teuthology.orchestra.console.smithi094:Power on
2023-11-16T17:55:25.260 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-16T17:55:25.272 INFO:teuthology.orchestra.console.smithi023:Power on
2023-11-16T17:55:25.272 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-16T17:55:25.282 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On
2023-11-16T17:55:25.282 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:25.291 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On
2023-11-16T17:55:25.292 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:25.302 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-16T17:55:25.311 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-16T17:55:29.066 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:29.174 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-16T17:55:29.275 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-16T17:55:29.302 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:29.311 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:29.376 INFO:teuthology.orchestra.console.smithi081:Power on
2023-11-16T17:55:29.376 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-16T17:55:29.396 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-11-16T17:55:29.397 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:29.411 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-16T17:55:29.416 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-16T17:55:29.419 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2023-11-16T17:55:29.520 INFO:teuthology.orchestra.console.smithi023:Power on completed
2023-11-16T17:55:29.620 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2023-11-16T17:55:29.620 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:55:33.415 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:33.422 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:33.525 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on
2023-11-16T17:55:33.531 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-16T17:55:33.626 INFO:teuthology.orchestra.console.smithi094:Power on completed
2023-11-16T17:55:33.727 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish
2023-11-16T17:55:33.727 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:55:37.534 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T17:55:37.643 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-16T17:55:37.743 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-11-16T17:55:37.844 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-11-16T17:55:37.844 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:55:44.718 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:55:48.822 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:55:52.939 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:55:59.817 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:56:03.918 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:56:08.030 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:56:14.914 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:56:19.011 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:56:25.044 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:56:30.026 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:56:34.102 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:56:40.206 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:56:45.144 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:56:49.220 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:56:55.346 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:57:00.258 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:57:04.326 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:57:10.506 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:57:15.417 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:57:19.550 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:57:25.830 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:57:30.772 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:57:35.370 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:57:43.958 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:57:46.146 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:57:50.722 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:57:59.717 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:58:01.759 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:58:06.118 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:58:15.065 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:58:17.785 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:58:21.472 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None
2023-11-16T17:58:22.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:58:30.420 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-16T17:58:30.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:58:30.918 ERROR:teuthology.orchestra.connection:Error authenticating with smithi081.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-16T17:58:33.504 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:58:40.762 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:58:46.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:58:48.889 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:58:49.818 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:58:55.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:58:58.877 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:59:04.260 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-16T17:59:04.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:04.699 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-16T17:59:04.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:07.930 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:59:09.434 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-16T17:59:13.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:15.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:18.497 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-16T17:59:20.026 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:59:24.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:26.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:27.578 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-16T17:59:29.082 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:59:33.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:35.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:38.138 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94
2023-11-16T17:59:43.227 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-16T17:59:44.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:44.542 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-16T17:59:44.542 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-16T17:59:45.116 INFO:teuthology.provision.fog.smithi094:Node is ready
2023-11-16T17:59:45.116 DEBUG:teuthology.orchestra.run.smithi094:> hostname
2023-11-16T17:59:45.132 INFO:teuthology.orchestra.run.smithi094.stdout:smithi022
2023-11-16T17:59:45.133 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi022 /etc/hosts
2023-11-16T17:59:45.189 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-16T17:59:45.189 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-11-16T17:59:45.313 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi022/smithi094/g' /etc/hosts
2023-11-16T17:59:45.339 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.22/172.21.15.94/g' /etc/hosts
2023-11-16T17:59:45.406 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi022/smithi094/g' /etc/hostname
2023-11-16T17:59:45.480 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094
2023-11-16T17:59:45.549 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-11-16T17:59:45.609 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux"
2023-11-16T17:59:45.609 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)"
2023-11-16T17:59:45.609 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel"
2023-11-16T17:59:45.609 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-16T17:59:45.610 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-16T17:59:45.611 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-16T17:59:45.611 INFO:teuthology.provision.fog.smithi094:Deploy complete!
2023-11-16T17:59:45.613 DEBUG:teuthology.parallel:result is None
2023-11-16T17:59:49.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T17:59:52.282 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-16T17:59:58.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:00:01.338 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-16T18:00:07.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:00:10.397 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-16T18:00:16.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:00:19.450 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-16T18:00:25.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:00:28.506 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-16T18:00:33.582 WARNING:teuthology.provision.fog.smithi081:timed out
2023-11-16T18:00:34.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:00:39.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:00:40.137 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-16T18:00:40.137 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-16T18:00:40.536 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-11-16T18:00:40.537 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-11-16T18:00:40.555 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081
2023-11-16T18:00:40.556 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081 /etc/hosts
2023-11-16T18:00:40.614 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-11-16T18:00:40.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-16T18:00:40.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hosts
2023-11-16T18:00:40.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-11-16T18:00:40.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hostname
2023-11-16T18:00:40.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-16T18:00:40.954 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-16T18:00:41.011 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-16T18:00:41.011 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-11-16T18:00:41.011 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-16T18:00:41.011 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-16T18:00:41.011 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-11-16T18:00:41.012 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-16T18:00:41.012 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-16T18:00:41.012 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-16T18:00:41.012 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-16T18:00:41.013 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-16T18:00:41.013 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-16T18:00:41.013 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-16T18:00:41.013 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-16T18:00:41.014 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-16T18:00:41.014 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-16T18:00:41.014 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-16T18:00:41.014 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-16T18:00:41.015 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-11-16T18:00:41.016 DEBUG:teuthology.parallel:result is None
2023-11-16T18:01:34.510 WARNING:teuthology.provision.fog.smithi023:timed out
2023-11-16T18:01:40.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:01:40.736 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-16T18:01:40.736 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-16T18:01:41.068 INFO:teuthology.provision.fog.smithi023:Node is ready
2023-11-16T18:01:41.068 DEBUG:teuthology.orchestra.run.smithi023:> hostname
2023-11-16T18:01:41.088 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2023-11-16T18:01:41.088 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts
2023-11-16T18:01:41.148 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2023-11-16T18:01:41.149 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2023-11-16T18:01:41.274 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts
2023-11-16T18:01:41.304 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts
2023-11-16T18:01:41.373 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname
2023-11-16T18:01:41.442 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2023-11-16T18:01:41.510 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2023-11-16T18:01:41.568 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux"
2023-11-16T18:01:41.568 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.6 (Ootpa)"
2023-11-16T18:01:41.568 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel"
2023-11-16T18:01:41.568 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.6"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-16T18:01:41.569 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-16T18:01:41.570 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2023-11-16T18:01:41.570 DEBUG:teuthology.parallel:result is None
2023-11-16T18:01:41.757 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2023-11-16T18:01:41.758 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-16T18:01:41.781 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-11-16T18:01:41.782 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-16T18:01:41.807 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com
2023-11-16T18:01:41.809 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2023-11-16T18:01:41.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2023-11-16T18:01:41.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:01:41.876 DEBUG:teuthology.orchestra.run.smithi023:> true
2023-11-16T18:01:41.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com'
2023-11-16T18:01:41.943 DEBUG:teuthology.orchestra.run.smithi023:> uname -m
2023-11-16T18:01:42.000 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2023-11-16T18:01:42.001 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2023-11-16T18:01:42.057 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux"
2023-11-16T18:01:42.057 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.6 (Ootpa)"
2023-11-16T18:01:42.057 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel"
2023-11-16T18:01:42.057 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.6"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-16T18:01:42.058 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-16T18:01:42.059 INFO:teuthology.orchestra.run.smithi023.stdout:
2023-11-16T18:01:42.059 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-16T18:01:42.059 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-16T18:01:42.059 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-16T18:01:42.059 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-16T18:01:42.060 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-11-16T18:01:42.081 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-11-16T18:01:42.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-16T18:01:42.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:01:42.149 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-11-16T18:01:42.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-16T18:01:42.284 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-11-16T18:01:42.341 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-11-16T18:01:42.341 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-16T18:01:42.398 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-16T18:01:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-16T18:01:42.400 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-16T18:01:42.400 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-16T18:01:42.400 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-16T18:01:42.400 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-16T18:01:42.400 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-16T18:01:42.423 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server
2023-11-16T18:01:42.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-11-16T18:01:42.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-16T18:01:42.490 DEBUG:teuthology.orchestra.run.smithi094:> true
2023-11-16T18:01:42.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com'
2023-11-16T18:01:42.625 DEBUG:teuthology.orchestra.run.smithi094:> uname -m
2023-11-16T18:01:42.683 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64
2023-11-16T18:01:42.684 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Red Hat Enterprise Linux"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8.6 (Ootpa)"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:ID="rhel"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="fedora"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8.6"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.redhat.com/"
2023-11-16T18:01:42.742 INFO:teuthology.orchestra.run.smithi094.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-16T18:01:42.743 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-16T18:01:42.743 INFO:teuthology.orchestra.run.smithi094.stdout:
2023-11-16T18:01:42.743 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-16T18:01:42.743 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-16T18:01:42.743 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-16T18:01:42.743 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-16T18:01:42.743 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server
2023-11-16T18:01:42.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:01:42.875 INFO:teuthology.dispatcher.supervisor:Running job 7460951
2023-11-16T18:01:42.876 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi/7460951 --name choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/misc}} -- /home/teuthworker/archive/choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi/7460951/orig.config.yaml
2023-11-16T18:01:42.878 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi/7460951
2023-11-16T18:01:42.879 INFO:teuthology.dispatcher.supervisor:Job PID: 1187263
2023-11-16T18:01:42.880 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-16T18:03:42.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:05:42.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:07:43.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:09:43.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:11:43.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:13:43.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:15:43.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:17:43.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:19:43.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:21:43.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:23:43.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:25:43.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:27:43.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:29:43.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:31:43.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:33:44.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:35:44.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:37:44.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:39:44.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-16T18:39:44.485 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-16T18:39:44.685 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-16T18:39:44.685 INFO:teuthology.nuke:Checking targets against current locks
2023-11-16T18:39:44.735 DEBUG:teuthology.nuke:shortname: smithi023
2023-11-16T18:39:44.735 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-16T18:39:44.753 DEBUG:teuthology.nuke:shortname: smithi081
2023-11-16T18:39:44.753 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-16T18:39:44.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi/7460951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:55:15.368243', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-16T18:39:44.768 DEBUG:teuthology.nuke:shortname: smithi094
2023-11-16T18:39:44.768 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-16T18:39:44.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi/7460951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:55:15.365548', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-16T18:39:44.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-16_17:54:03-fs-wip-choffman-62793-distro-default-smithi/7460951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 17:55:15.367009', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-16T18:39:44.812 INFO:teuthology.orchestra.console.smithi023:Power off
2023-11-16T18:39:44.813 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-16T18:39:44.840 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off
2023-11-16T18:39:44.840 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T18:39:44.857 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-16T18:39:44.857 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-16T18:39:44.870 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-16T18:39:44.880 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-16T18:39:44.880 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T18:39:44.893 INFO:teuthology.orchestra.console.smithi094:Power off
2023-11-16T18:39:44.894 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-16T18:39:44.904 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-16T18:39:44.917 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off
2023-11-16T18:39:44.917 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-16T18:39:44.939 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off
2023-11-16T18:39:44.971 INFO:teuthology.orchestra.console.smithi023:Power off completed
2023-11-16T18:39:45.005 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-16T18:39:45.041 INFO:teuthology.orchestra.console.smithi094:Power off completed
2023-11-16T18:39:45.158 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2023-11-16T18:39:45.164 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-11-16T18:39:45.188 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com