2023-07-06T00:52:01.217 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T00:52:01.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T00:52:01.219 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T00:52:01.412 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faaf2ba88b0>, signals=[15]) 2023-07-06T00:52:01.414 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-07-06T00:52:01.414 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T00:52:01.414 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-06T00:52:01.439 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-07-06T00:52:01.439 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T00:52:01.441 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-06T00:52:01.442 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-07-06T00:52:01.463 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-07-06T00:52:01.463 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-07-06T00:52:01.463 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-06T00:52:01.464 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-07-06T00:52:01.488 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-07-06T00:52:01.524 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T00:52:01.545 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T00:52:01.558 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-06T00:52:01.566 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T00:52:01.566 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 5} 2023-07-06T00:52:01.586 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T00:52:01.586 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 5} 2023-07-06T00:52:01.599 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-06T00:52:01.599 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 5} 2023-07-06T00:52:01.604 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.6 2023-07-06T00:52:01.604 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:52:01.633 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6 2023-07-06T00:52:01.633 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:52:01.644 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of rhel 8.6 2023-07-06T00:52:01.645 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:52:01.649 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T00:52:01.676 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T00:52:01.684 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-07-06T00:52:01.686 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-07-06T00:52:01.709 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-07-06T00:52:01.722 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-07-06T00:52:01.736 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:52:01.759 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:52:01.772 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:52:01.826 INFO:teuthology.orchestra.console:Power off smithi092 2023-07-06T00:52:01.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T00:52:01.855 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-06T00:52:01.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T00:52:01.871 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-06T00:52:01.871 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T00:52:01.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:01.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:01.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:05.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:05.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:05.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:10.031 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:10.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:10.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:10.245 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-07-06T00:52:10.346 INFO:teuthology.orchestra.console:Power on smithi092 2023-07-06T00:52:10.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T00:52:10.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:14.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:14.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:14.369 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-06T00:52:14.379 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-06T00:52:14.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:14.470 INFO:teuthology.orchestra.console:Power on smithi139 2023-07-06T00:52:14.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T00:52:14.480 INFO:teuthology.orchestra.console:Power on smithi151 2023-07-06T00:52:14.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-06T00:52:14.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:14.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:18.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:18.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:18.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:18.745 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-07-06T00:52:18.802 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2023-07-06T00:52:18.847 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-07-06T00:52:18.848 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:52:18.904 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-07-06T00:52:18.904 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:52:22.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:52:22.866 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2023-07-06T00:52:22.967 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-07-06T00:52:22.968 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:52:33.924 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:52:33.951 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:52:38.040 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:52:49.000 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:52:49.010 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:52:53.108 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:53:04.076 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:53:04.078 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:53:08.168 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:53:19.145 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:53:19.146 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:53:23.228 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:53:34.209 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:53:34.211 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:53:38.285 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:53:49.277 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:53:49.278 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:53:53.336 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:54:04.348 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:54:04.350 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:54:08.388 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:54:19.409 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:54:19.410 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:54:23.436 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:54:34.472 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:54:34.478 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:54:38.488 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:54:49.532 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:54:49.534 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-06T00:54:49.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:54:49.842 ERROR:teuthology.orchestra.connection:Error authenticating with smithi092.front.sepia.ceph.com: Authentication failed. 2023-07-06T00:54:49.844 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T00:54:49.845 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T00:54:49.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-06T00:54:53.542 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:55:04.598 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-06T00:55:04.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:07.732 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-06T00:55:08.597 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-07-06T00:55:08.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:11.728 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:55:13.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:16.784 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-06T00:55:17.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:20.784 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:55:22.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:25.840 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-06T00:55:26.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:29.840 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:55:31.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:34.900 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-06T00:55:35.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:38.896 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:55:40.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:43.952 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-06T00:55:44.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:47.952 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:55:49.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:53.012 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-06T00:55:53.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:55:57.012 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:55:59.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:56:03.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:56:06.068 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-06T00:56:12.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:56:45.936 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-06T00:56:45.938 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi092 2023-07-06T00:56:54.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-06T00:56:54.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:56:55.504 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-06T00:56:55.818 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-06T00:56:55.819 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T00:56:55.819 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T00:56:55.836 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-07-06T00:56:55.837 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-07-06T00:56:55.895 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092 2023-07-06T00:56:55.895 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092 /etc/hosts 2023-07-06T00:56:55.952 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-07-06T00:56:55.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-07-06T00:56:56.067 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092/smithi092/g' /etc/hosts 2023-07-06T00:56:56.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-07-06T00:56:56.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092/smithi092/g' /etc/hostname 2023-07-06T00:56:56.231 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-07-06T00:56:56.297 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-06T00:56:56.354 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T00:56:56.354 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T00:56:56.355 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-07-06T00:56:56.355 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-07-06T00:56:56.355 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-07-06T00:56:56.355 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:56:56.355 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T00:56:56.355 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T00:56:56.356 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T00:56:56.357 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T00:56:56.357 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-07-06T00:56:56.358 DEBUG:teuthology.parallel:result is None 2023-07-06T00:56:59.016 WARNING:teuthology.provision.fog.smithi139:timed out 2023-07-06T00:57:05.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:57:05.287 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T00:57:05.287 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T00:57:05.733 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-07-06T00:57:05.733 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-07-06T00:57:05.751 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-07-06T00:57:05.752 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-07-06T00:57:05.810 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-07-06T00:57:05.810 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-06T00:57:05.937 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-07-06T00:57:05.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-07-06T00:57:06.033 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-07-06T00:57:06.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-06T00:57:06.167 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-06T00:57:06.223 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T00:57:06.224 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T00:57:06.224 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-07-06T00:57:06.224 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-07-06T00:57:06.224 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-07-06T00:57:06.224 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:57:06.224 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-07-06T00:57:06.225 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:57:06.226 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T00:57:06.226 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T00:57:06.226 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T00:57:06.226 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-07-06T00:57:06.227 DEBUG:teuthology.parallel:result is None 2023-07-06T00:57:12.071 WARNING:teuthology.provision.fog.smithi151:timed out 2023-07-06T00:57:18.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:57:18.398 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-06T00:57:18.398 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-06T00:57:18.697 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-07-06T00:57:18.697 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-07-06T00:57:18.716 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151 2023-07-06T00:57:18.717 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151 /etc/hosts 2023-07-06T00:57:18.771 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-07-06T00:57:18.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-07-06T00:57:18.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151/smithi151/g' /etc/hosts 2023-07-06T00:57:18.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-07-06T00:57:18.983 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151/smithi151/g' /etc/hostname 2023-07-06T00:57:19.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-07-06T00:57:19.129 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-06T00:57:19.185 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T00:57:19.185 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T00:57:19.186 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-07-06T00:57:19.186 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-07-06T00:57:19.186 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-07-06T00:57:19.186 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:57:19.186 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T00:57:19.187 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-07-06T00:57:19.187 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T00:57:19.187 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T00:57:19.187 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T00:57:19.187 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:57:19.187 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-06T00:57:19.188 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:57:19.188 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T00:57:19.189 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T00:57:19.189 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T00:57:19.189 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-07-06T00:57:19.190 DEBUG:teuthology.parallel:result is None 2023-07-06T00:57:19.472 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-07-06T00:57:19.473 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-07-06T00:57:19.473 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T00:57:19.500 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-07-06T00:57:19.500 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-06T00:57:19.526 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-07-06T00:57:19.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-06T00:57:19.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:57:19.596 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-06T00:57:19.667 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-06T00:57:19.668 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-07-06T00:57:19.726 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-07-06T00:57:19.727 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-06T00:57:19.784 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T00:57:19.784 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T00:57:19.784 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T00:57:19.785 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T00:57:19.786 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T00:57:19.787 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-06T00:57:19.808 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-07-06T00:57:19.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-06T00:57:19.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:57:19.877 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-07-06T00:57:20.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-06T00:57:20.006 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-07-06T00:57:20.064 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-07-06T00:57:20.065 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-06T00:57:20.122 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T00:57:20.123 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:57:20.124 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T00:57:20.125 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T00:57:20.125 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T00:57:20.125 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-06T00:57:20.149 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-07-06T00:57:20.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-06T00:57:20.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:57:20.217 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-06T00:57:20.244 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-06T00:57:20.244 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-07-06T00:57:20.302 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-07-06T00:57:20.302 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-06T00:57:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T00:57:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T00:57:20.361 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T00:57:20.362 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T00:57:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T00:57:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T00:57:20.363 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-06T00:57:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T00:57:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T00:57:20.363 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T00:57:20.364 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T00:57:20.364 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-06T00:57:20.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T00:57:20.392 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T00:57:20.504 INFO:teuthology.dispatcher.supervisor:Running job 7327783 2023-07-06T00:57:20.505 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327783 --name rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327783/orig.config.yaml 2023-07-06T00:57:20.509 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327783 2023-07-06T00:57:20.512 INFO:teuthology.dispatcher.supervisor:Job PID: 26670 2023-07-06T00:57:20.512 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-06T00:59:20.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T00:59:20.531 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:01:20.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:01:20.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:03:20.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:03:20.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:05:21.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:05:21.061 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:07:21.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:07:21.234 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:09:21.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:09:21.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:11:21.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:11:21.585 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:13:21.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:13:21.765 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:15:21.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:15:21.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:17:22.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:17:22.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:19:22.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:19:22.306 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:21:22.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:21:22.487 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:23:22.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:23:22.665 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:25:22.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:25:22.841 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:27:23.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:27:23.014 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:29:23.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:29:23.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:31:23.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:31:23.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:33:23.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:33:23.536 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:35:23.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:35:23.709 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:37:24.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:37:24.677 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:39:28.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:39:28.466 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:41:28.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:41:28.638 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:43:42.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:43:42.413 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:45:47.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:45:47.598 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:47:52.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:47:52.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:49:57.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:49:57.969 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:52:03.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:52:03.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:54:08.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:54:08.338 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:56:08.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:56:08.525 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T01:58:08.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T01:58:08.706 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T02:00:13.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T02:00:13.891 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T02:00:18.979 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-06T02:00:34.228 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-06T02:00:34.229 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T02:00:49.299 DEBUG:teuthology.nuke:shortname: smithi092 2023-07-06T02:00:49.299 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T02:01:09.346 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:52:00.266634', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T02:01:09.347 DEBUG:teuthology.nuke:shortname: smithi139 2023-07-06T02:01:09.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T02:01:24.391 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:52:00.268218', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-06T02:01:24.393 DEBUG:teuthology.nuke:shortname: smithi151 2023-07-06T02:01:24.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T02:01:39.435 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327783', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 00:52:00.269553', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T02:01:39.443 INFO:teuthology.orchestra.console:Power off smithi092 2023-07-06T02:01:39.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T02:01:41.905 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-06T02:01:41.906 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T02:01:41.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:01:41.944 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-06T02:01:41.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T02:01:41.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:01:42.054 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-06T02:01:42.093 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-06T02:01:42.214 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-07-06T02:01:42.246 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com 2023-07-06T02:01:44.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:01:49.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:01:54.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:01:59.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:02:04.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:02:09.935 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T02:02:10.148 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-07-06T02:02:20.309 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com