2023-07-14T17:05:56.578 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T17:05:56.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:05:56.580 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:05:56.793 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36490e98b0>, signals=[15]) 2023-07-14T17:05:56.795 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2023-07-14T17:05:56.795 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T17:05:56.795 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-07-14T17:05:56.815 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2023-07-14T17:05:56.815 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T17:05:56.815 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-14T17:05:56.817 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /host {"name": "smithi018"} 2023-07-14T17:05:59.073 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-07-14T17:05:59.073 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T17:05:59.073 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-07-14T17:05:59.074 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"} 2023-07-14T17:05:59.098 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-07-14T17:05:59.136 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T17:05:59.146 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T17:05:59.169 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T17:05:59.172 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T17:05:59.173 DEBUG:teuthology.provision.fog.smithi018:FOG request: PUT /host/124 {"imageID": 5} 2023-07-14T17:05:59.194 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T17:05:59.194 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 5} 2023-07-14T17:05:59.204 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T17:05:59.204 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 5} 2023-07-14T17:05:59.214 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of rhel 8.6 2023-07-14T17:05:59.214 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:05:59.239 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of rhel 8.6 2023-07-14T17:05:59.239 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T17:06:09.251 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T17:06:09.253 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of rhel 8.6 2023-07-14T17:06:09.253 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-07-14T17:06:23.546 DEBUG:teuthology.provision.fog.smithi018:FOG request: POST /host/124/task {"taskTypeID": 1} 2023-07-14T17:06:23.570 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T17:06:23.573 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T17:06:23.616 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:06:23.621 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1} 2023-07-14T17:06:23.622 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-07-14T17:06:23.674 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T17:06:23.681 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-07-14T17:06:38.748 INFO:teuthology.orchestra.console:Power off smithi192 2023-07-14T17:06:38.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T17:06:38.762 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-14T17:06:38.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T17:06:38.775 INFO:teuthology.orchestra.console:Power off smithi018 2023-07-14T17:06:38.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T17:06:38.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:38.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:38.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:42.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:42.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:42.835 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:47.929 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:47.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:47.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:48.155 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2023-07-14T17:06:48.256 INFO:teuthology.orchestra.console:Power on smithi018 2023-07-14T17:06:48.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T17:06:48.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:52.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:53.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:53.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:53.252 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-14T17:06:53.353 INFO:teuthology.orchestra.console:Power on smithi050 2023-07-14T17:06:53.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T17:06:53.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:57.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:57.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:06:58.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:01.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:01.726 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2023-07-14T17:07:01.827 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2023-07-14T17:07:01.828 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None 2023-07-14T17:07:06.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:06.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:06.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:12.034 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-07-14T17:07:12.135 INFO:teuthology.orchestra.console:Power on smithi192 2023-07-14T17:07:12.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T17:07:12.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:14.992 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-14T17:07:16.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:16.395 INFO:teuthology.orchestra.console:Power on for smithi192 completed 2023-07-14T17:07:16.497 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-07-14T17:07:16.498 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-07-14T17:07:16.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:16.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:19.632 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:07:20.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:22.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:24.048 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-14T17:07:25.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:30.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:07:30.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:35.653 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:07:35.768 INFO:teuthology.orchestra.console:Power on for smithi018 completed 2023-07-14T17:07:35.869 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2023-07-14T17:07:35.869 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:07:40.877 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2023-07-14T17:07:41.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:44.720 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:07:46.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:51.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:07:54.580 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:07:55.956 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:08:00.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:08:09.040 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:08:15.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:08:21.043 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:08:26.047 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:08:32.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:08:41.124 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:08:50.416 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-07-14T17:08:51.498 WARNING:teuthology.provision.fog.smithi050:timed out 2023-07-14T17:08:56.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:08:56.546 ERROR:teuthology.orchestra.connection:Error authenticating with smithi192.front.sepia.ceph.com: Authentication failed. 2023-07-14T17:08:56.548 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T17:08:56.548 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T17:08:56.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:08:57.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:08:57.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:08:57.577 ERROR:teuthology.orchestra.connection:Error authenticating with smithi050.front.sepia.ceph.com: Authentication failed. 2023-07-14T17:08:57.578 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T17:08:57.578 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T17:08:57.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:08:58.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:08:58.587 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:08:59.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:08:59.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:00.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:00.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:01.225 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:09:06.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:06.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:07.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:07.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:08.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:08.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:09.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:09.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:10.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:10.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:11.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:11.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:12.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:12.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:13.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:13.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:14.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:14.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:15.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:15.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:16.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:16.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:17.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:17.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:18.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:18.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:19.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:19.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:20.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:20.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:21.318 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:09:26.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:27.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:28.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:29.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:30.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:31.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:32.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:33.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:34.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:35.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:36.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:37.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:38.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:39.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:40.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:41.407 DEBUG:teuthology.provision.fog.smithi018:FOG request: GET /task/active None 2023-07-14T17:09:46.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:46.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:09:51.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:52.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:53.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:54.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-14T17:09:54.576 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-07-14T17:10:00.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:10:08.660 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-07-14T17:10:14.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:11:14.288 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-14T17:11:14.290 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi050 2023-07-14T17:11:19.668 WARNING:teuthology.provision.fog.smithi018:timed out 2023-07-14T17:11:23.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-14T17:11:23.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:11:23.615 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-07-14T17:11:23.878 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-14T17:11:23.879 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T17:11:23.879 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T17:11:23.897 INFO:teuthology.provision.fog.smithi050:Node is ready 2023-07-14T17:11:23.897 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2023-07-14T17:11:23.955 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2023-07-14T17:11:23.956 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2023-07-14T17:11:24.014 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2023-07-14T17:11:24.015 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-14T17:11:24.138 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2023-07-14T17:11:24.168 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2023-07-14T17:11:24.237 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2023-07-14T17:11:24.305 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2023-07-14T17:11:24.371 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-14T17:11:24.428 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:11:24.429 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:11:24.429 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-07-14T17:11:24.429 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-07-14T17:11:24.429 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2023-07-14T17:11:24.429 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:11:24.429 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-07-14T17:11:24.430 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:11:24.431 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:11:24.431 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:11:24.431 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:11:24.431 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2023-07-14T17:11:24.433 DEBUG:teuthology.parallel:result is None 2023-07-14T17:11:25.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:11:26.003 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T17:11:26.004 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T17:11:26.333 INFO:teuthology.provision.fog.smithi018:Node is ready 2023-07-14T17:11:26.334 DEBUG:teuthology.orchestra.run.smithi018:> hostname 2023-07-14T17:11:26.352 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2023-07-14T17:11:26.353 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts 2023-07-14T17:11:26.411 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2023-07-14T17:11:26.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-07-14T17:11:26.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts 2023-07-14T17:11:26.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts 2023-07-14T17:11:26.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname 2023-07-14T17:11:26.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-07-14T17:11:26.767 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-07-14T17:11:26.824 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:11:26.824 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:11:26.824 INFO:teuthology.orchestra.run.smithi018.stdout:ID="rhel" 2023-07-14T17:11:26.824 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="fedora" 2023-07-14T17:11:26.824 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8.6" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:11:26.825 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:11:26.826 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-07-14T17:11:26.826 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:11:26.826 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:11:26.826 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:11:26.826 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:11:26.827 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2023-07-14T17:11:26.827 DEBUG:teuthology.parallel:result is None 2023-07-14T17:11:42.960 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-14T17:11:42.961 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi192 2023-07-14T17:11:51.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-07-14T17:11:51.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:11:57.400 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-07-14T17:11:57.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-07-14T17:11:57.680 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T17:11:57.680 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T17:11:57.697 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-07-14T17:11:57.697 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-07-14T17:11:57.754 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-07-14T17:11:57.754 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-07-14T17:11:57.811 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-07-14T17:11:57.811 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-07-14T17:11:57.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-07-14T17:11:57.956 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-07-14T17:11:58.023 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-07-14T17:11:58.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-07-14T17:11:58.154 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-07-14T17:11:58.210 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:11:58.210 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:11:58.210 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:11:58.211 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:11:58.212 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:11:58.213 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-07-14T17:11:58.213 DEBUG:teuthology.parallel:result is None 2023-07-14T17:12:03.420 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2023-07-14T17:12:03.421 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T17:12:08.448 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2023-07-14T17:12:08.448 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T17:12:10.415 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-07-14T17:12:10.416 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-14T17:12:10.441 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2023-07-14T17:12:10.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-07-14T17:12:10.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:12:10.510 DEBUG:teuthology.orchestra.run.smithi018:> true 2023-07-14T17:12:10.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-07-14T17:12:10.648 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2023-07-14T17:12:10.706 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2023-07-14T17:12:10.706 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-07-14T17:12:10.765 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:12:10.765 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:12:10.765 INFO:teuthology.orchestra.run.smithi018.stdout:ID="rhel" 2023-07-14T17:12:10.765 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="fedora" 2023-07-14T17:12:10.766 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8.6" 2023-07-14T17:12:10.766 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:12:10.766 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:12:10.766 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2023-07-14T17:12:10.766 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout: 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:12:10.767 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:12:10.768 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:12:10.768 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-07-14T17:12:10.790 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2023-07-14T17:12:10.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-14T17:12:10.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:12:10.859 DEBUG:teuthology.orchestra.run.smithi050:> true 2023-07-14T17:12:10.997 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2023-07-14T17:12:10.998 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2023-07-14T17:12:11.056 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2023-07-14T17:12:11.056 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2023-07-14T17:12:11.113 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:12:11.114 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:12:11.114 INFO:teuthology.orchestra.run.smithi050.stdout:ID="rhel" 2023-07-14T17:12:11.114 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="fedora" 2023-07-14T17:12:11.114 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8.6" 2023-07-14T17:12:11.114 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:12:11.115 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:12:11.115 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2023-07-14T17:12:11.115 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:12:11.115 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:12:11.115 INFO:teuthology.orchestra.run.smithi050.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:12:11.116 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:12:11.116 INFO:teuthology.orchestra.run.smithi050.stdout: 2023-07-14T17:12:11.116 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:12:11.116 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:12:11.117 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:12:11.117 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:12:11.118 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2023-07-14T17:12:11.139 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-07-14T17:12:11.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-07-14T17:12:11.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T17:12:11.206 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-07-14T17:12:11.276 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-07-14T17:12:11.276 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-07-14T17:12:11.335 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-07-14T17:12:11.336 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-07-14T17:12:11.394 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T17:12:11.394 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T17:12:11.394 INFO:teuthology.orchestra.run.smithi192.stdout:ID="rhel" 2023-07-14T17:12:11.394 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="fedora" 2023-07-14T17:12:11.394 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8.6" 2023-07-14T17:12:11.394 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T17:12:11.395 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-07-14T17:12:11.396 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T17:12:11.396 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T17:12:11.396 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T17:12:11.396 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T17:12:11.397 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-07-14T17:12:11.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:12:11.423 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:12:11.534 INFO:teuthology.dispatcher.supervisor:Running job 7337970 2023-07-14T17:12:11.535 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337970 --name pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/test_o_trunc}} -- /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337970/orig.config.yaml 2023-07-14T17:12:11.539 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337970 2023-07-14T17:12:11.539 INFO:teuthology.dispatcher.supervisor:Job PID: 20205 2023-07-14T17:12:11.540 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T17:14:11.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:14:11.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:16:16.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:16:16.811 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:18:21.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:18:21.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:20:26.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:20:26.589 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:22:31.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:22:31.770 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:24:32.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:24:32.461 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:26:35.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:26:35.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:28:40.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:28:40.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:30:46.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:30:46.094 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:32:51.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:32:51.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:34:56.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:34:56.446 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:37:01.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:37:01.619 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:39:06.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:39:06.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:41:12.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:41:12.003 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:43:17.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T17:43:17.146 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T17:43:17.224 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T17:43:17.474 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T17:43:17.475 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T17:43:17.519 DEBUG:teuthology.nuke:shortname: smithi018 2023-07-14T17:43:17.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T17:43:23.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:05:55.668043', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T17:43:23.918 DEBUG:teuthology.nuke:shortname: smithi050 2023-07-14T17:43:23.918 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T17:43:23.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:05:55.671521', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T17:43:23.942 DEBUG:teuthology.nuke:shortname: smithi192 2023-07-14T17:43:23.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T17:43:23.964 INFO:teuthology.orchestra.console:Power off smithi018 2023-07-14T17:43:23.965 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T17:43:23.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337970', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:05:55.670000', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T17:43:23.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:43:24.012 INFO:teuthology.orchestra.console:Power off smithi050 2023-07-14T17:43:24.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T17:43:24.031 INFO:teuthology.orchestra.console:Power off smithi192 2023-07-14T17:43:24.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T17:43:24.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:43:24.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T17:43:24.123 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2023-07-14T17:43:24.164 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2023-07-14T17:43:24.175 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-07-14T17:43:24.282 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2023-07-14T17:43:24.313 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2023-07-14T17:43:24.321 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com