2023-07-20T19:34:52.136 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-20T19:34:52.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:34:52.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:34:52.341 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa96cb314f0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa96c4e1940>, signals=[15])
2023-07-20T19:34:52.343 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2023-07-20T19:34:52.343 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T19:34:52.343 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-07-20T19:34:52.364 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-07-20T19:34:52.365 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T19:34:52.365 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-07-20T19:34:52.367 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"}
2023-07-20T19:35:02.406 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2023-07-20T19:35:02.407 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T19:35:02.407 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2023-07-20T19:35:02.408 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"}
2023-07-20T19:35:15.010 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"}
2023-07-20T19:35:25.248 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-20T19:35:25.281 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-20T19:35:25.307 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-20T19:35:25.307 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 5}
2023-07-20T19:35:25.316 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-20T19:35:25.322 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-20T19:35:25.322 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 5}
2023-07-20T19:35:25.352 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-20T19:35:25.352 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 5}
2023-07-20T19:35:25.360 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.6
2023-07-20T19:35:25.360 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T19:35:25.373 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6
2023-07-20T19:35:25.373 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-07-20T19:35:25.405 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.6
2023-07-20T19:35:25.406 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:35:25.423 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T19:35:25.442 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T19:35:25.468 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1}
2023-07-20T19:35:25.482 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T19:35:25.483 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1}
2023-07-20T19:35:25.525 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T19:35:30.532 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-07-20T19:35:30.533 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1}
2023-07-20T19:35:35.637 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:35:35.656 INFO:teuthology.orchestra.console:Power off smithi003
2023-07-20T19:35:35.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T19:35:35.687 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:35.711 INFO:teuthology.orchestra.console:Power off smithi098
2023-07-20T19:35:35.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T19:35:35.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:35.760 INFO:teuthology.orchestra.console:Power off smithi134
2023-07-20T19:35:35.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T19:35:35.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:39.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:39.774 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:39.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:43.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:43.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:43.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:44.100 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2023-07-20T19:35:44.201 INFO:teuthology.orchestra.console:Power on smithi098
2023-07-20T19:35:44.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T19:35:44.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:47.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:48.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:48.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:53.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:53.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:53.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:58.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:58.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:58.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:35:58.678 INFO:teuthology.orchestra.console:Power on for smithi098 completed
2023-07-20T19:35:58.779 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-07-20T19:35:58.779 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-07-20T19:36:00.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:36:03.760 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-20T19:36:04.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:04.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:04.857 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2023-07-20T19:36:04.958 INFO:teuthology.orchestra.console:Power on smithi134
2023-07-20T19:36:04.959 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T19:36:04.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:09.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:09.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:09.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:36:14.871 INFO:teuthology.orchestra.console:Power on for smithi134 completed
2023-07-20T19:36:14.877 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-07-20T19:36:14.972 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2023-07-20T19:36:14.972 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:36:19.974 INFO:teuthology.orchestra.console:Power on smithi003
2023-07-20T19:36:19.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T19:36:19.983 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-20T19:36:24.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:25.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:36:34.068 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-20T19:36:34.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:35.049 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:36:40.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:36:43.152 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-20T19:36:44.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:49.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:36:54.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T19:36:54.165 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:36:59.168 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-20T19:36:59.284 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2023-07-20T19:36:59.384 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2023-07-20T19:36:59.385 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T19:37:04.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:37:09.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:37:14.476 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:37:14.478 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T19:37:20.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:37:23.536 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T19:37:29.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:37:34.545 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:37:37.964 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed.
2023-07-20T19:37:37.967 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T19:37:37.969 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T19:37:37.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:38.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:39.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:40.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:41.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:42.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:44.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:45.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:46.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:47.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:48.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:49.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:50.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:51.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:52.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:52.986 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:37:57.993 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:37:58.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:00.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:01.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:02.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:03.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:04.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:05.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:06.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:06.174 ERROR:teuthology.orchestra.connection:Error authenticating with smithi003.front.sepia.ceph.com: Authentication failed.
2023-07-20T19:38:06.174 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T19:38:06.174 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T19:38:06.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:07.043 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:07.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:08.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:08.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:09.060 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:09.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:10.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:10.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:11.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:11.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:12.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:12.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:13.073 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:38:18.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:18.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:19.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:19.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:20.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:20.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:21.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:21.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:22.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:22.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:23.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:23.113 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:24.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:24.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:25.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:25.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:26.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:26.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:27.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:27.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:28.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:29.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:30.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:31.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:32.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:33.169 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:38:38.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:39.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:40.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:41.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:42.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:43.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:44.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:45.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:46.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:47.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:48.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:49.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:50.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:51.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:52.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:53.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:53.273 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-07-20T19:38:53.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:38:54.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:55.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:56.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-20T19:38:56.400 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-07-20T19:39:02.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:39:05.456 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-07-20T19:39:11.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:39:14.512 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-07-20T19:39:20.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:39:23.572 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-07-20T19:39:29.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:39:37.648 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-07-20T19:39:43.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:39:46.704 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-07-20T19:39:52.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:40:15.857 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-20T19:40:15.858 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi098
2023-07-20T19:40:24.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-07-20T19:40:24.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:40:30.261 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-07-20T19:40:30.433 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T19:40:30.434 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T19:40:30.530 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-07-20T19:40:30.530 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T19:40:30.531 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T19:40:30.546 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-07-20T19:40:30.547 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2023-07-20T19:40:30.602 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2023-07-20T19:40:30.603 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2023-07-20T19:40:30.659 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2023-07-20T19:40:30.659 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-07-20T19:40:30.768 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2023-07-20T19:40:30.795 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2023-07-20T19:40:30.826 INFO:teuthology.provision.fog.smithi134:Node is ready
2023-07-20T19:40:30.826 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2023-07-20T19:40:30.841 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2023-07-20T19:40:30.842 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2023-07-20T19:40:30.861 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2023-07-20T19:40:30.897 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2023-07-20T19:40:30.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2023-07-20T19:40:30.927 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-07-20T19:40:30.992 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-07-20T19:40:31.048 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-20T19:40:31.049 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-20T19:40:31.050 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T19:40:31.051 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-20T19:40:31.052 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-07-20T19:40:31.053 DEBUG:teuthology.parallel:result is None
2023-07-20T19:40:31.079 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2023-07-20T19:40:31.106 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2023-07-20T19:40:31.173 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2023-07-20T19:40:31.241 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2023-07-20T19:40:31.306 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2023-07-20T19:40:31.361 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-20T19:40:31.362 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2023-07-20T19:40:31.363 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-20T19:40:31.363 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T19:40:31.363 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T19:40:31.363 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T19:40:31.363 INFO:teuthology.orchestra.run.smithi134.stdout:
2023-07-20T19:40:31.363 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T19:40:31.364 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-20T19:40:31.364 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T19:40:31.364 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-20T19:40:31.364 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2023-07-20T19:40:31.365 DEBUG:teuthology.parallel:result is None
2023-07-20T19:40:44.528 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-20T19:40:44.529 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi003
2023-07-20T19:40:53.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-20T19:40:53.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:40:53.865 DEBUG:teuthology.orchestra.run.smithi003:> true
2023-07-20T19:40:54.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-20T19:40:54.145 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T19:40:54.145 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T19:40:54.164 INFO:teuthology.provision.fog.smithi003:Node is ready
2023-07-20T19:40:54.165 DEBUG:teuthology.orchestra.run.smithi003:> hostname
2023-07-20T19:40:54.223 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com
2023-07-20T19:40:54.224 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts
2023-07-20T19:40:54.283 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003
2023-07-20T19:40:54.283 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003
2023-07-20T19:40:54.406 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts
2023-07-20T19:40:54.436 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts
2023-07-20T19:40:54.506 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname
2023-07-20T19:40:54.576 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003
2023-07-20T19:40:54.643 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release
2023-07-20T19:40:54.700 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T19:40:54.700 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)"
2023-07-20T19:40:54.700 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel"
2023-07-20T19:40:54.701 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora"
2023-07-20T19:40:54.701 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6"
2023-07-20T19:40:54.701 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2023-07-20T19:40:54.701 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-20T19:40:54.701 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-07-20T19:40:54.701 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-20T19:40:54.702 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T19:40:54.702 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T19:40:54.702 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T19:40:54.702 INFO:teuthology.orchestra.run.smithi003.stdout:
2023-07-20T19:40:54.702 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T19:40:54.702 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-20T19:40:54.703 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T19:40:54.703 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-20T19:40:54.703 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2023-07-20T19:40:54.704 DEBUG:teuthology.parallel:result is None
2023-07-20T19:40:57.018 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2023-07-20T19:40:57.019 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T19:40:57.039 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-07-20T19:40:57.040 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T19:40:57.055 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2023-07-20T19:40:57.056 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T19:40:57.074 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2023-07-20T19:40:57.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-20T19:40:57.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:40:57.142 DEBUG:teuthology.orchestra.run.smithi003:> true
2023-07-20T19:40:57.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-20T19:40:57.213 DEBUG:teuthology.orchestra.run.smithi003:> uname -m
2023-07-20T19:40:57.271 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2023-07-20T19:40:57.272 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release
2023-07-20T19:40:57.330 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T19:40:57.330 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-07-20T19:40:57.331 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T19:40:57.332 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-20T19:40:57.333 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-07-20T19:40:57.356 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-07-20T19:40:57.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-07-20T19:40:57.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:40:57.424 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-07-20T19:40:57.554 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-07-20T19:40:57.554 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2023-07-20T19:40:57.611 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-07-20T19:40:57.612 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-07-20T19:40:57.670 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T19:40:57.670 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-07-20T19:40:57.671 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-20T19:40:57.672 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T19:40:57.673 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-20T19:40:57.673 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-07-20T19:40:57.698 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2023-07-20T19:40:57.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2023-07-20T19:40:57.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T19:40:57.767 DEBUG:teuthology.orchestra.run.smithi134:> true
2023-07-20T19:40:57.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2023-07-20T19:40:57.899 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2023-07-20T19:40:57.955 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2023-07-20T19:40:57.956 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2023-07-20T19:40:58.013 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2023-07-20T19:40:58.014 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)"
2023-07-20T19:40:58.014 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2023-07-20T19:40:58.014 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2023-07-20T19:40:58.014 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6"
2023-07-20T19:40:58.014 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2023-07-20T19:40:58.015 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-20T19:40:58.015 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2023-07-20T19:40:58.015 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-20T19:40:58.015 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2023-07-20T19:40:58.015 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-20T19:40:58.015 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T19:40:58.016 INFO:teuthology.orchestra.run.smithi134.stdout:
2023-07-20T19:40:58.016 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-20T19:40:58.016 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-20T19:40:58.016 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-20T19:40:58.016 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-20T19:40:58.017 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2023-07-20T19:40:58.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:40:58.040 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:40:58.147 INFO:teuthology.dispatcher.supervisor:Running job 7345430
2023-07-20T19:40:58.148 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345430 --name pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345430/orig.config.yaml
2023-07-20T19:40:58.151 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345430
2023-07-20T19:40:58.152 INFO:teuthology.dispatcher.supervisor:Job PID: 6598
2023-07-20T19:40:58.152 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-20T19:42:58.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:42:58.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:45:03.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:45:03.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:47:08.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:47:08.635 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:49:13.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:49:13.809 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:51:17.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:51:17.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:53:22.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:53:22.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:55:23.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:55:23.054 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:57:23.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:57:23.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T19:59:23.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T19:59:23.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:01:23.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:01:23.566 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:03:23.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:03:23.741 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:05:23.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:05:23.914 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:07:24.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:07:24.087 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:09:24.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:09:24.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:11:24.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:11:24.442 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:13:24.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:13:24.614 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:15:24.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:15:24.785 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:17:24.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T20:17:24.957 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T20:17:25.046 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-20T20:17:25.210 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-20T20:17:25.211 INFO:teuthology.nuke:Checking targets against current locks
2023-07-20T20:17:25.271 DEBUG:teuthology.nuke:shortname: smithi003
2023-07-20T20:17:25.273 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T20:17:25.308 DEBUG:teuthology.nuke:shortname: smithi098
2023-07-20T20:17:25.308 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T20:17:25.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 19:34:51.235427', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-20T20:17:25.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 19:34:51.233745', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-20T20:17:25.335 DEBUG:teuthology.nuke:shortname: smithi134
2023-07-20T20:17:25.336 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T20:17:25.372 INFO:teuthology.orchestra.console:Power off smithi003
2023-07-20T20:17:25.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T20:17:25.389 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_19:23:18-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7345430', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 19:34:51.236809', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-20T20:17:25.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T20:17:25.429 INFO:teuthology.orchestra.console:Power off smithi098
2023-07-20T20:17:25.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T20:17:25.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T20:17:25.471 INFO:teuthology.orchestra.console:Power off smithi134
2023-07-20T20:17:25.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T20:17:25.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T20:17:25.539 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-07-20T20:17:25.583 INFO:teuthology.orchestra.console:Power off for smithi098 completed
2023-07-20T20:17:25.624 INFO:teuthology.orchestra.console:Power off for smithi134 completed
2023-07-20T20:17:25.695 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2023-07-20T20:17:25.735 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-07-20T20:17:25.776 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com