2023-11-08T06:54:59.832 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-08T06:54:59.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T06:55:00.010 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f22f490faf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f22f53f8670>, signals=[15])
2023-11-08T06:55:00.012 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging
2023-11-08T06:55:00.012 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T06:55:00.012 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2023-11-08T06:55:00.033 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2023-11-08T06:55:00.034 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T06:55:00.034 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-11-08T06:55:00.036 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /host {"name": "smithi122"}
2023-11-08T06:55:00.058 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-11-08T06:55:00.058 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T06:55:00.059 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-11-08T06:55:00.060 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"}
2023-11-08T06:55:00.084 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-11-08T06:55:00.107 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-08T06:55:00.142 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-08T06:55:00.149 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-08T06:55:00.153 DEBUG:teuthology.provision.fog.smithi122:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-08T06:55:00.153 DEBUG:teuthology.provision.fog.smithi122:FOG request: PUT /host/227 {"imageID": 5}
2023-11-08T06:55:00.182 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-08T06:55:00.182 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 5}
2023-11-08T06:55:00.205 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of rhel 8.6
2023-11-08T06:55:00.205 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:55:00.208 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-08T06:55:00.209 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 5}
2023-11-08T06:55:00.224 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of rhel 8.6
2023-11-08T06:55:00.224 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:55:00.250 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.6
2023-11-08T06:55:00.250 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:55:00.274 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T06:55:00.289 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T06:55:00.308 DEBUG:teuthology.provision.fog.smithi122:FOG request: POST /host/227/task {"taskTypeID": 1}
2023-11-08T06:55:00.313 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T06:55:00.325 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-11-08T06:55:00.350 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1}
2023-11-08T06:55:00.366 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:55:00.376 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:55:00.411 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:55:00.473 INFO:teuthology.orchestra.console.smithi122:Power off
2023-11-08T06:55:00.473 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T06:55:00.496 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off
2023-11-08T06:55:00.497 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:00.518 INFO:teuthology.orchestra.console.smithi203:Power off
2023-11-08T06:55:00.519 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T06:55:00.530 INFO:teuthology.orchestra.console.smithi164:Power off
2023-11-08T06:55:00.531 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T06:55:00.536 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2023-11-08T06:55:00.540 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-11-08T06:55:00.540 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:00.549 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2023-11-08T06:55:00.550 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:00.564 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-08T06:55:00.571 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-11-08T06:55:00.671 INFO:teuthology.orchestra.console.smithi164:Power off completed
2023-11-08T06:55:00.772 INFO:teuthology.orchestra.console.smithi164:Power on
2023-11-08T06:55:00.772 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T06:55:00.797 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On
2023-11-08T06:55:00.798 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:00.819 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-11-08T06:55:04.541 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:04.565 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:04.650 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2023-11-08T06:55:04.673 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-08T06:55:04.820 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:04.929 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2023-11-08T06:55:05.030 INFO:teuthology.orchestra.console.smithi164:Power on completed
2023-11-08T06:55:05.131 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2023-11-08T06:55:05.132 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:55:08.654 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:08.674 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:08.764 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2023-11-08T06:55:08.782 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-08T06:55:08.883 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-11-08T06:55:08.984 INFO:teuthology.orchestra.console.smithi203:Power on
2023-11-08T06:55:08.984 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T06:55:09.007 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-11-08T06:55:09.008 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:09.029 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-08T06:55:12.766 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:12.875 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-08T06:55:12.976 INFO:teuthology.orchestra.console.smithi122:Power off completed
2023-11-08T06:55:13.031 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:13.077 INFO:teuthology.orchestra.console.smithi122:Power on
2023-11-08T06:55:13.078 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T06:55:13.105 DEBUG:teuthology.orchestra.console.smithi122:power on output: Chassis Power Control: Up/On
2023-11-08T06:55:13.106 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:13.129 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-08T06:55:13.141 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-08T06:55:17.130 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:17.143 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T06:55:17.240 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is on
2023-11-08T06:55:17.253 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-08T06:55:17.342 INFO:teuthology.orchestra.console.smithi122:Power on completed
2023-11-08T06:55:17.354 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-11-08T06:55:17.444 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish
2023-11-08T06:55:17.444 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:55:17.456 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-11-08T06:55:17.456 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:55:20.225 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:55:32.546 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:55:32.548 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:55:35.313 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:55:47.640 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:55:47.642 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:55:50.390 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:56:02.740 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:56:02.742 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:56:05.485 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:56:17.848 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:56:17.850 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:56:20.562 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:56:32.926 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:56:32.928 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:56:35.636 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:56:47.998 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:56:48.000 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:56:50.706 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:57:03.078 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:57:03.080 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:57:05.792 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:57:18.163 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:57:18.164 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:57:20.862 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:57:33.246 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:57:33.248 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:57:35.926 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:57:48.327 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:57:48.328 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:57:51.006 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-08T06:57:51.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:03.402 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-08T06:58:03.405 DEBUG:teuthology.provision.fog.smithi122:FOG request: GET /task/active None
2023-11-08T06:58:03.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:03.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:09.402 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-08T06:58:15.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:18.491 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-08T06:58:21.946 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:58:21.947 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:58:24.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:27.578 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-08T06:58:27.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:27.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:31.034 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:58:31.066 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:58:33.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:36.666 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-08T06:58:37.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:37.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:40.122 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:58:40.158 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:58:42.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:45.758 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-08T06:58:46.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:46.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:49.210 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:58:49.242 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:58:51.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:55.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:55.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:58:58.298 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:58:58.331 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:59:04.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:04.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:14.682 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:59:20.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:22.878 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:59:23.770 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:59:28.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:29.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:31.962 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:59:32.858 WARNING:teuthology.provision.fog.smithi122:[Errno None] Unable to connect to port 22 on 172.21.15.122
2023-11-08T06:59:37.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:38.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:41.050 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-08T06:59:42.112 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T06:59:42.113 DEBUG:teuthology.orchestra.run.smithi122:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T06:59:42.423 INFO:teuthology.provision.fog.smithi122:Node is ready
2023-11-08T06:59:42.423 DEBUG:teuthology.orchestra.run.smithi122:> hostname
2023-11-08T06:59:42.443 INFO:teuthology.orchestra.run.smithi122.stdout:smithi022
2023-11-08T06:59:42.443 DEBUG:teuthology.orchestra.run.smithi122:> grep smithi022 /etc/hosts
2023-11-08T06:59:42.503 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-08T06:59:42.503 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2023-11-08T06:59:42.624 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi022/smithi122/g' /etc/hosts
2023-11-08T06:59:42.657 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/172.21.15.22/172.21.15.122/g' /etc/hosts
2023-11-08T06:59:42.730 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i -e 's/smithi022/smithi122/g' /etc/hostname
2023-11-08T06:59:42.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname smithi122
2023-11-08T06:59:42.874 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2023-11-08T06:59:42.933 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T06:59:42.934 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.6 (Ootpa)"
2023-11-08T06:59:42.934 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2023-11-08T06:59:42.934 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2023-11-08T06:59:42.934 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.6"
2023-11-08T06:59:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2023-11-08T06:59:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-08T06:59:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2023-11-08T06:59:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-08T06:59:42.935 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T06:59:42.936 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T06:59:42.936 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T06:59:42.936 INFO:teuthology.orchestra.run.smithi122.stdout:
2023-11-08T06:59:42.936 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T06:59:42.936 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-08T06:59:42.937 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T06:59:42.937 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-08T06:59:42.938 INFO:teuthology.provision.fog.smithi122:Deploy complete!
2023-11-08T06:59:42.939 DEBUG:teuthology.parallel:result is None
2023-11-08T06:59:47.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:47.390 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T06:59:47.391 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T06:59:47.734 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-11-08T06:59:47.734 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-11-08T06:59:47.752 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-11-08T06:59:47.752 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-11-08T06:59:47.809 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-11-08T06:59:47.810 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-11-08T06:59:47.980 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-11-08T06:59:48.007 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-11-08T06:59:48.074 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-11-08T06:59:48.140 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-11-08T06:59:48.206 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-11-08T06:59:48.262 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T06:59:48.263 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)"
2023-11-08T06:59:48.263 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel"
2023-11-08T06:59:48.263 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora"
2023-11-08T06:59:48.263 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6"
2023-11-08T06:59:48.264 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-11-08T06:59:48.264 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-08T06:59:48.264 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-11-08T06:59:48.264 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-08T06:59:48.264 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T06:59:48.265 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T06:59:48.265 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T06:59:48.265 INFO:teuthology.orchestra.run.smithi203.stdout:
2023-11-08T06:59:48.265 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T06:59:48.265 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-08T06:59:48.266 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T06:59:48.266 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-08T06:59:48.266 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-11-08T06:59:48.267 DEBUG:teuthology.parallel:result is None
2023-11-08T06:59:51.774 WARNING:teuthology.provision.fog.smithi164:timed out
2023-11-08T06:59:57.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:58.137 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T06:59:58.137 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T06:59:58.407 INFO:teuthology.provision.fog.smithi164:Node is ready
2023-11-08T06:59:58.408 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2023-11-08T06:59:58.425 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2023-11-08T06:59:58.425 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts
2023-11-08T06:59:58.483 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2023-11-08T06:59:58.483 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-11-08T06:59:58.581 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts
2023-11-08T06:59:58.609 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2023-11-08T06:59:58.678 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname
2023-11-08T06:59:58.745 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-11-08T06:59:58.812 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-11-08T06:59:58.870 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T06:59:58.870 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)"
2023-11-08T06:59:58.870 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel"
2023-11-08T06:59:58.870 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora"
2023-11-08T06:59:58.871 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6"
2023-11-08T06:59:58.871 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2023-11-08T06:59:58.871 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-08T06:59:58.871 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-11-08T06:59:58.873 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-08T06:59:58.873 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T06:59:58.873 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T06:59:58.873 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T06:59:58.874 INFO:teuthology.orchestra.run.smithi164.stdout:
2023-11-08T06:59:58.874 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T06:59:58.874 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-08T06:59:58.874 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T06:59:58.874 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-08T06:59:58.875 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2023-11-08T06:59:58.875 DEBUG:teuthology.parallel:result is None
2023-11-08T06:59:59.271 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com
2023-11-08T06:59:59.272 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T06:59:59.299 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2023-11-08T06:59:59.300 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T06:59:59.324 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-11-08T06:59:59.325 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T06:59:59.351 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server
2023-11-08T06:59:59.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'
2023-11-08T06:59:59.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:59.436 DEBUG:teuthology.orchestra.run.smithi122:> true
2023-11-08T06:59:59.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com'
2023-11-08T06:59:59.573 DEBUG:teuthology.orchestra.run.smithi122:> uname -m
2023-11-08T06:59:59.631 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64
2023-11-08T06:59:59.631 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release
2023-11-08T06:59:59.688 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T06:59:59.688 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8.6 (Ootpa)"
2023-11-08T06:59:59.689 INFO:teuthology.orchestra.run.smithi122.stdout:ID="rhel"
2023-11-08T06:59:59.689 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="fedora"
2023-11-08T06:59:59.689 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8.6"
2023-11-08T06:59:59.689 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8"
2023-11-08T06:59:59.689 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-08T06:59:59.690 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31"
2023-11-08T06:59:59.690 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-08T06:59:59.690 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T06:59:59.690 INFO:teuthology.orchestra.run.smithi122.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T06:59:59.691 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T06:59:59.691 INFO:teuthology.orchestra.run.smithi122.stdout:
2023-11-08T06:59:59.691 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T06:59:59.691 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-08T06:59:59.691 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T06:59:59.692 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-08T06:59:59.693 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2023-11-08T06:59:59.725 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2023-11-08T06:59:59.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-11-08T06:59:59.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T06:59:59.798 DEBUG:teuthology.orchestra.run.smithi164:> true
2023-11-08T06:59:59.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-11-08T06:59:59.821 DEBUG:teuthology.orchestra.run.smithi164:> uname -m
2023-11-08T06:59:59.878 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2023-11-08T06:59:59.878 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-11-08T06:59:59.935 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T06:59:59.935 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)"
2023-11-08T06:59:59.936 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel"
2023-11-08T06:59:59.936 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora"
2023-11-08T06:59:59.936 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6"
2023-11-08T06:59:59.936 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2023-11-08T06:59:59.937 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-08T06:59:59.937 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-11-08T06:59:59.937 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-08T06:59:59.937 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T06:59:59.937 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T06:59:59.938 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T06:59:59.938 INFO:teuthology.orchestra.run.smithi164.stdout:
2023-11-08T06:59:59.938 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T06:59:59.938 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-08T06:59:59.938 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T06:59:59.939 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-08T06:59:59.939 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-11-08T06:59:59.975 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-11-08T06:59:59.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-11-08T06:59:59.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T07:00:00.050 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-11-08T07:00:00.142 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-11-08T07:00:00.143 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-11-08T07:00:00.200 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-11-08T07:00:00.200 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-11-08T07:00:00.257 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T07:00:00.257 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)"
2023-11-08T07:00:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel"
2023-11-08T07:00:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora"
2023-11-08T07:00:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6"
2023-11-08T07:00:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-11-08T07:00:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-08T07:00:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-11-08T07:00:00.259 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-08T07:00:00.259 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T07:00:00.259 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T07:00:00.259 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T07:00:00.259 INFO:teuthology.orchestra.run.smithi203.stdout:
2023-11-08T07:00:00.260 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T07:00:00.260 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-08T07:00:00.260 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T07:00:00.260 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-08T07:00:00.261 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-11-08T07:00:00.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:00:00.390 INFO:teuthology.dispatcher.supervisor:Running job 7451807
2023-11-08T07:00:00.391 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi/7451807 --name mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi/7451807/orig.config.yaml
2023-11-08T07:00:00.394 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi/7451807
2023-11-08T07:00:00.394 INFO:teuthology.dispatcher.supervisor:Job PID: 3707014
2023-11-08T07:00:00.395 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-08T07:02:00.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:04:00.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:06:00.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:08:01.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:10:01.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:12:01.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:14:01.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:16:01.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:18:01.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:20:01.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:22:02.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:24:02.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:26:02.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:28:02.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:30:02.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:32:03.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:34:03.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:36:03.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:38:03.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:40:03.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:42:03.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:44:04.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:46:04.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:48:04.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:50:04.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:52:04.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:54:04.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:56:05.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T07:56:05.093 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-08T07:56:05.331 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-08T07:56:05.332 INFO:teuthology.nuke:Checking targets against current locks
2023-11-08T07:56:05.381 DEBUG:teuthology.nuke:shortname: smithi122
2023-11-08T07:56:05.382 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T07:56:05.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi/7451807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 06:54:58.977296', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-08T07:56:05.416 DEBUG:teuthology.nuke:shortname: smithi164
2023-11-08T07:56:05.416 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T07:56:05.437 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi/7451807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 06:54:58.981038', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-08T07:56:05.441 DEBUG:teuthology.nuke:shortname: smithi203
2023-11-08T07:56:05.441 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T07:56:05.471 INFO:teuthology.orchestra.console.smithi122:Power off
2023-11-08T07:56:05.472 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T07:56:05.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-08_06:49:56-fs:workload-main-distro-default-smithi/7451807', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 06:54:58.979273', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-08T07:56:05.493 DEBUG:teuthology.orchestra.console.smithi122:power off output: Chassis Power Control: Down/Off
2023-11-08T07:56:05.495 DEBUG:teuthology.orchestra.console.smithi122:pexpect command: ipmitool -H smithi122.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T07:56:05.517 INFO:teuthology.orchestra.console.smithi164:Power off
2023-11-08T07:56:05.518 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T07:56:05.531 DEBUG:teuthology.orchestra.console.smithi122:check power output: Chassis Power is off
2023-11-08T07:56:05.540 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2023-11-08T07:56:05.540 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T07:56:05.558 INFO:teuthology.orchestra.console.smithi203:Power off
2023-11-08T07:56:05.559 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T07:56:05.568 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-11-08T07:56:05.582 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-11-08T07:56:05.583 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T07:56:05.604 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-08T07:56:05.633 INFO:teuthology.orchestra.console.smithi122:Power off completed
2023-11-08T07:56:05.669 INFO:teuthology.orchestra.console.smithi164:Power off completed
2023-11-08T07:56:05.706 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-11-08T07:56:05.784 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com
2023-11-08T07:56:05.817 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com
2023-11-08T07:56:05.858 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com