2023-07-19T15:54:06.394 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T15:54:06.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T15:54:06.396 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T15:54:16.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa5f4ec98b0>, signals=[15]) 2023-07-19T15:54:16.094 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-19T15:54:16.095 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T15:54:16.095 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-19T15:54:16.121 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-07-19T15:54:16.122 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T15:54:16.122 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-19T15:54:16.124 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-19T15:54:21.228 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-07-19T15:54:21.229 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T15:54:21.229 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-07-19T15:54:21.231 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-07-19T15:54:36.250 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-07-19T15:54:36.278 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T15:54:41.295 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T15:54:41.295 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 5} 2023-07-19T15:54:46.307 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T15:54:46.310 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T15:54:46.344 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6 2023-07-19T15:54:46.345 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:54:46.363 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T15:54:46.363 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 5} 2023-07-19T15:54:46.366 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T15:54:46.366 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 5} 2023-07-19T15:54:46.418 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T15:54:46.422 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of rhel 8.6 2023-07-19T15:54:46.422 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-19T15:54:46.426 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6 2023-07-19T15:54:46.427 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:54:46.470 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-19T15:54:46.500 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T15:54:46.505 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T15:54:46.538 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:54:46.555 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-07-19T15:54:46.556 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-07-19T15:54:46.620 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:54:46.634 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-19T15:54:46.667 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-19T15:54:46.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T15:55:01.702 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:01.732 INFO:teuthology.orchestra.console:Power off smithi125 2023-07-19T15:55:01.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T15:55:01.748 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-19T15:55:01.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T15:55:01.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:01.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:01.893 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-19T15:55:01.994 INFO:teuthology.orchestra.console:Power on smithi118 2023-07-19T15:55:01.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T15:55:02.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:05.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:06.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:06.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:09.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:10.108 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-07-19T15:55:10.154 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:10.209 INFO:teuthology.orchestra.console:Power on smithi125 2023-07-19T15:55:10.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T15:55:10.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:10.365 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-07-19T15:55:10.466 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-07-19T15:55:10.467 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-19T15:55:10.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:55:11.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:12.039 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-19T15:55:12.140 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-19T15:55:12.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T15:55:12.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:13.616 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:55:14.263 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:16.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:19.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:19.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:55:24.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:24.735 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2023-07-19T15:55:24.836 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-07-19T15:55:24.837 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:55:29.845 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:55:33.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:35.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:55:38.928 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:55:38.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:44.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T15:55:44.918 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:55:49.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:55:55.028 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-19T15:55:55.129 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-19T15:55:55.129 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:55:58.000 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:56:04.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:56:10.006 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:56:11.754 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:56:16.761 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:56:22.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:56:27.773 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:56:32.776 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:56:32.777 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:56:38.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:56:52.857 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:56:57.861 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:57:02.864 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-19T15:57:08.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:57:13.953 ERROR:teuthology.orchestra.connection:Error authenticating with smithi118.front.sepia.ceph.com: Authentication failed. 2023-07-19T15:57:13.955 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T15:57:13.955 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T15:57:13.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:14.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:15.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:16.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:17.928 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:57:17.935 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:57:17.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:18.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:19.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:20.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:21.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:22.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:23.999 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:25.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:26.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:27.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:28.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:29.021 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:30.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:31.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:32.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:32.996 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:57:33.007 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:57:33.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:34.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:35.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:36.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:37.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:38.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:39.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:40.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:41.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:42.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:43.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:44.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:45.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:46.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:47.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:48.082 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:57:49.840 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-19T15:57:49.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:49.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:57:50.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:51.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:52.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:52.976 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-19T15:57:53.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:54.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:55.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:56.883 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:57.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:58.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:57:58.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:03.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:04.927 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-19T15:58:09.932 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-19T15:58:09.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:10.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:10.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:11.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:12.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:13.076 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-07-19T15:58:13.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:14.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:15.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:15.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:16.971 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T15:58:18.992 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-19T15:58:19.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:22.128 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-07-19T15:58:24.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:29.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:38.068 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-07-19T15:58:44.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:58:52.144 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-07-19T15:58:58.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:59:29.998 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-19T15:59:36.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T15:59:41.253 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T15:59:41.253 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T15:59:41.547 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-19T15:59:41.547 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-19T15:59:41.565 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-19T15:59:41.566 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-19T15:59:41.625 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-19T15:59:41.626 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-19T15:59:41.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-19T15:59:41.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-19T15:59:41.840 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-19T15:59:41.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-19T15:59:41.975 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-19T15:59:42.032 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T15:59:42.032 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T15:59:42.032 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-07-19T15:59:42.032 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-07-19T15:59:42.032 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T15:59:42.033 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T15:59:42.034 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-07-19T15:59:42.034 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T15:59:42.034 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T15:59:42.034 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T15:59:42.034 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T15:59:42.035 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-19T15:59:42.036 DEBUG:teuthology.parallel:result is None 2023-07-19T15:59:58.148 WARNING:teuthology.provision.fog.smithi125:timed out 2023-07-19T16:00:04.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:00:09.780 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T16:00:09.781 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T16:00:10.041 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-07-19T16:00:10.041 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-07-19T16:00:10.103 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125 2023-07-19T16:00:10.103 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125 /etc/hosts 2023-07-19T16:00:10.165 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-07-19T16:00:10.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-07-19T16:00:10.281 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125/smithi125/g' /etc/hosts 2023-07-19T16:00:10.309 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-07-19T16:00:10.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125/smithi125/g' /etc/hostname 2023-07-19T16:00:10.451 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-07-19T16:00:10.521 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-07-19T16:00:10.581 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:00:10.582 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:00:10.582 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-07-19T16:00:10.583 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-07-19T16:00:10.583 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-07-19T16:00:10.583 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:00:10.584 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:00:10.584 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-07-19T16:00:10.584 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:00:10.585 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:00:10.585 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:00:10.585 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:00:10.585 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-07-19T16:00:10.586 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:00:10.586 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:00:10.586 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:00:10.587 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:00:10.587 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-07-19T16:00:10.588 DEBUG:teuthology.parallel:result is None 2023-07-19T16:00:58.484 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-19T16:00:58.486 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi118 2023-07-19T16:01:07.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-19T16:01:07.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:01:12.822 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-19T16:01:13.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-19T16:01:13.116 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T16:01:13.116 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T16:01:13.135 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-07-19T16:01:13.136 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-07-19T16:01:13.199 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118 2023-07-19T16:01:13.200 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118 /etc/hosts 2023-07-19T16:01:13.259 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-07-19T16:01:13.260 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-19T16:01:13.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118/smithi118/g' /etc/hosts 2023-07-19T16:01:13.413 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-07-19T16:01:13.481 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118/smithi118/g' /etc/hostname 2023-07-19T16:01:13.550 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-19T16:01:13.616 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-19T16:01:13.673 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-19T16:01:13.674 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:01:13.675 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:01:13.676 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:01:13.676 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-07-19T16:01:13.676 DEBUG:teuthology.parallel:result is None 2023-07-19T16:01:18.893 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-19T16:01:18.894 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T16:01:18.915 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-07-19T16:01:18.915 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T16:01:18.939 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-07-19T16:01:18.939 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T16:01:18.966 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-19T16:01:18.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-19T16:01:18.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:01:19.035 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-19T16:01:19.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-19T16:01:19.171 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-19T16:01:19.232 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-19T16:01:19.233 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-19T16:01:19.292 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:01:19.292 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:01:19.292 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:01:19.293 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:01:19.294 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:01:19.294 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-07-19T16:01:19.294 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:01:19.294 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:01:19.294 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:01:19.294 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:01:19.295 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-19T16:01:19.315 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-07-19T16:01:19.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-19T16:01:19.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:01:19.382 DEBUG:teuthology.orchestra.run.smithi118:> true 2023-07-19T16:01:19.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-07-19T16:01:19.453 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2023-07-19T16:01:19.513 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-07-19T16:01:19.513 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-19T16:01:19.572 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:01:19.573 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:01:19.573 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-07-19T16:01:19.573 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:01:19.574 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:01:19.575 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:01:19.575 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-19T16:01:19.575 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:01:19.575 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:01:19.575 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:01:19.576 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:01:19.576 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-19T16:01:19.599 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-07-19T16:01:19.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-07-19T16:01:19.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T16:01:19.666 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-07-19T16:01:19.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-07-19T16:01:19.809 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-07-19T16:01:19.869 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-07-19T16:01:19.869 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-07-19T16:01:19.929 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T16:01:19.929 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T16:01:19.929 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2023-07-19T16:01:19.929 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2023-07-19T16:01:19.929 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2023-07-19T16:01:19.930 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-07-19T16:01:19.930 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T16:01:19.930 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-07-19T16:01:19.930 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T16:01:19.930 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T16:01:19.930 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T16:01:19.931 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T16:01:19.931 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-07-19T16:01:19.931 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T16:01:19.931 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T16:01:19.931 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T16:01:19.932 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T16:01:19.932 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-07-19T16:01:19.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:01:19.959 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:01:20.152 INFO:teuthology.dispatcher.supervisor:Running job 7344079 2023-07-19T16:01:20.152 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344079 --name pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344079/orig.config.yaml 2023-07-19T16:01:20.156 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344079 2023-07-19T16:01:20.157 INFO:teuthology.dispatcher.supervisor:Job PID: 3690 2023-07-19T16:01:20.158 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-19T16:03:20.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:03:20.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:05:20.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:05:20.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:07:25.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:07:25.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:09:31.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:09:31.054 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:11:36.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:11:36.249 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:13:41.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:13:41.430 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:15:46.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:15:46.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:17:51.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:17:51.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:19:52.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:19:52.001 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:21:52.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:21:52.178 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:23:52.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:23:52.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:25:52.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:25:52.541 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:27:52.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:27:52.719 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:29:52.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:29:52.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:31:53.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:31:53.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:33:53.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:33:53.323 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:35:53.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:35:53.489 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:37:53.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:37:53.665 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:39:53.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:39:53.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:41:54.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:41:54.013 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:43:54.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T16:43:54.189 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T16:43:54.264 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-19T16:43:54.490 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-19T16:43:54.491 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T16:43:54.552 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-19T16:43:54.552 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T16:43:54.579 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 15:53:45.478568', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T16:43:54.585 DEBUG:teuthology.nuke:shortname: smithi118 2023-07-19T16:43:54.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T16:43:54.605 DEBUG:teuthology.nuke:shortname: smithi125 2023-07-19T16:43:54.605 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T16:43:54.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 15:53:45.479823', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T16:43:54.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 15:53:45.477068', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T16:43:54.644 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-19T16:43:54.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T16:43:54.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:43:54.686 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-19T16:43:54.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T16:43:54.706 INFO:teuthology.orchestra.console:Power off smithi125 2023-07-19T16:43:54.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T16:43:54.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:43:54.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T16:43:54.819 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-19T16:43:54.844 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-19T16:43:54.856 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-07-19T16:43:54.980 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-07-19T16:43:54.995 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-07-19T16:43:55.003 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com