2023-07-18T02:50:20.689 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-18T02:50:20.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:50:20.691 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:50:20.883 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc0d18978b0>, signals=[15]) 2023-07-18T02:50:20.885 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-07-18T02:50:20.885 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T02:50:20.885 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-18T02:50:20.906 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2023-07-18T02:50:20.906 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T02:50:20.907 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-18T02:50:20.908 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-07-18T02:50:20.931 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-07-18T02:50:20.931 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-07-18T02:50:20.932 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-07-18T02:50:20.933 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /host {"name": "smithi008"} 2023-07-18T02:50:20.956 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-07-18T02:50:20.987 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-18T02:50:21.027 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-18T02:50:21.027 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 5} 2023-07-18T02:50:21.037 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-18T02:50:21.039 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-18T02:50:21.078 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-18T02:50:21.078 DEBUG:teuthology.provision.fog.smithi008:FOG request: PUT /host/114 {"imageID": 5} 2023-07-18T02:50:21.081 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-18T02:50:21.081 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 5} 2023-07-18T02:50:21.084 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of rhel 8.6 2023-07-18T02:50:21.084 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:50:21.137 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6 2023-07-18T02:50:21.137 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:50:21.140 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of rhel 8.6 2023-07-18T02:50:21.140 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:50:21.153 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T02:50:21.186 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T02:50:21.190 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /tasktype {"name": "deploy"} 2023-07-18T02:50:21.192 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-07-18T02:50:21.221 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-07-18T02:50:21.230 DEBUG:teuthology.provision.fog.smithi008:FOG request: POST /host/114/task {"taskTypeID": 1} 2023-07-18T02:50:21.330 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:50:21.360 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:50:21.390 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:50:21.459 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-18T02:50:21.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T02:50:21.481 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-18T02:50:21.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T02:50:21.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:21.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:21.527 INFO:teuthology.orchestra.console:Power off smithi033 2023-07-18T02:50:21.528 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T02:50:21.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:25.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:25.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:25.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:29.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:29.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:29.687 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:29.864 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-18T02:50:29.871 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-18T02:50:29.965 INFO:teuthology.orchestra.console:Power on smithi003 2023-07-18T02:50:29.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T02:50:29.975 INFO:teuthology.orchestra.console:Power on smithi008 2023-07-18T02:50:29.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T02:50:29.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:30.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:33.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:35.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:35.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:38.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:40.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:40.126 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:44.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:45.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:45.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:49.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:50.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:50.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:50:50.559 INFO:teuthology.orchestra.console:Power on for smithi008 completed 2023-07-18T02:50:50.661 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2023-07-18T02:50:50.662 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:51:00.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:51:00.783 INFO:teuthology.orchestra.console:Power on for smithi003 completed 2023-07-18T02:51:00.884 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-07-18T02:51:00.885 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-07-18T02:51:00.885 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:51:00.986 INFO:teuthology.orchestra.console:Power on smithi033 2023-07-18T02:51:00.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-18T02:51:01.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:51:05.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:51:09.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T02:51:09.354 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2023-07-18T02:51:09.456 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-07-18T02:51:09.456 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:51:15.764 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:51:15.950 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:51:24.544 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:51:30.844 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:51:31.021 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:51:44.624 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:51:45.924 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:51:46.080 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:51:59.693 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:52:04.701 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:52:04.702 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:52:24.776 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:52:24.778 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:52:24.779 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:52:54.864 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:52:54.865 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:52:54.866 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:53:09.936 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:53:09.938 DEBUG:teuthology.provision.fog.smithi008:FOG request: GET /task/active None 2023-07-18T02:53:09.939 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-07-18T02:53:14.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:14.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:18.064 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-18T02:53:18.065 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-18T02:53:24.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:29.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:34.078 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-07-18T02:53:34.079 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-18T02:53:39.085 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-18T02:53:39.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:44.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:49.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:49.139 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-07-18T02:53:52.208 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-18T02:53:52.209 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-18T02:53:55.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:58.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:58.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:53:58.224 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-07-18T02:54:01.264 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-07-18T02:54:01.296 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2023-07-18T02:54:04.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:54:07.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:54:07.280 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-07-18T02:54:07.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:54:13.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:07.324 WARNING:teuthology.provision.fog.smithi003:timed out 2023-07-18T02:55:07.326 WARNING:teuthology.provision.fog.smithi008:timed out 2023-07-18T02:55:13.292 WARNING:teuthology.provision.fog.smithi033:timed out 2023-07-18T02:55:13.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:13.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:13.575 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T02:55:13.576 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T02:55:13.665 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T02:55:13.665 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T02:55:13.879 INFO:teuthology.provision.fog.smithi008:Node is ready 2023-07-18T02:55:13.879 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2023-07-18T02:55:13.898 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2023-07-18T02:55:13.898 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2023-07-18T02:55:13.958 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2023-07-18T02:55:13.958 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-18T02:55:13.969 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-07-18T02:55:13.969 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-07-18T02:55:13.988 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-07-18T02:55:13.988 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-07-18T02:55:14.046 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-07-18T02:55:14.048 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-18T02:55:14.073 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2023-07-18T02:55:14.103 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2023-07-18T02:55:14.158 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-07-18T02:55:14.173 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2023-07-18T02:55:14.188 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-07-18T02:55:14.244 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2023-07-18T02:55:14.258 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-07-18T02:55:14.314 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-18T02:55:14.326 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-07-18T02:55:14.371 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-07-18T02:55:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2023-07-18T02:55:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-07-18T02:55:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-07-18T02:55:14.372 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2023-07-18T02:55:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-18T02:55:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-18T02:55:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-18T02:55:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-18T02:55:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-07-18T02:55:14.373 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-18T02:55:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T02:55:14.374 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-07-18T02:55:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T02:55:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-18T02:55:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-18T02:55:14.374 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-18T02:55:14.375 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2023-07-18T02:55:14.377 DEBUG:teuthology.parallel:result is None 2023-07-18T02:55:14.393 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-18T02:55:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-18T02:55:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-07-18T02:55:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-18T02:55:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-18T02:55:14.450 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T02:55:14.451 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-18T02:55:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T02:55:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-18T02:55:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-18T02:55:14.452 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-18T02:55:14.452 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-07-18T02:55:14.453 DEBUG:teuthology.parallel:result is None 2023-07-18T02:55:19.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:19.634 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-18T02:55:19.635 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-18T02:55:19.953 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-07-18T02:55:19.954 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-07-18T02:55:19.972 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-07-18T02:55:19.973 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-07-18T02:55:20.031 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-07-18T02:55:20.032 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-07-18T02:55:20.145 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-07-18T02:55:20.175 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-07-18T02:55:20.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-07-18T02:55:20.313 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-07-18T02:55:20.381 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-07-18T02:55:20.437 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-07-18T02:55:20.438 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2023-07-18T02:55:20.438 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-07-18T02:55:20.438 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-07-18T02:55:20.438 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-18T02:55:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T02:55:20.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-07-18T02:55:20.440 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T02:55:20.440 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-18T02:55:20.440 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-18T02:55:20.441 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-18T02:55:20.441 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-07-18T02:55:20.442 DEBUG:teuthology.parallel:result is None 2023-07-18T02:55:20.639 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-07-18T02:55:20.640 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T02:55:20.664 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2023-07-18T02:55:20.664 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-18T02:55:20.689 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-07-18T02:55:20.690 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-07-18T02:55:20.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-18T02:55:20.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:20.759 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-07-18T02:55:20.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-07-18T02:55:20.837 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-07-18T02:55:20.900 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-07-18T02:55:20.900 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-07-18T02:55:20.962 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Red Hat Enterprise Linux" 2023-07-18T02:55:20.963 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8.6 (Ootpa)" 2023-07-18T02:55:20.963 INFO:teuthology.orchestra.run.smithi003.stdout:ID="rhel" 2023-07-18T02:55:20.963 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="fedora" 2023-07-18T02:55:20.963 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8.6" 2023-07-18T02:55:20.964 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-07-18T02:55:20.964 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-18T02:55:20.964 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-07-18T02:55:20.964 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-18T02:55:20.964 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.redhat.com/" 2023-07-18T02:55:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-18T02:55:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T02:55:20.965 INFO:teuthology.orchestra.run.smithi003.stdout: 2023-07-18T02:55:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T02:55:20.965 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-18T02:55:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-18T02:55:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-18T02:55:20.966 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-07-18T02:55:20.989 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2023-07-18T02:55:20.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-18T02:55:20.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:21.066 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-07-18T02:55:21.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-07-18T02:55:21.139 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-07-18T02:55:21.202 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-07-18T02:55:21.203 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-07-18T02:55:21.264 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-07-18T02:55:21.264 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2023-07-18T02:55:21.264 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-07-18T02:55:21.264 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-07-18T02:55:21.265 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-18T02:55:21.266 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T02:55:21.266 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-07-18T02:55:21.266 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T02:55:21.266 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-18T02:55:21.266 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-18T02:55:21.266 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-18T02:55:21.267 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-07-18T02:55:21.298 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-07-18T02:55:21.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-07-18T02:55:21.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-18T02:55:21.415 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-07-18T02:55:21.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-07-18T02:55:21.497 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-07-18T02:55:21.561 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-07-18T02:55:21.561 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-07-18T02:55:21.626 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-07-18T02:55:21.627 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2023-07-18T02:55:21.627 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-07-18T02:55:21.627 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-07-18T02:55:21.628 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2023-07-18T02:55:21.628 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-07-18T02:55:21.628 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-18T02:55:21.629 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-07-18T02:55:21.629 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-18T02:55:21.629 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-07-18T02:55:21.629 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-18T02:55:21.630 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-18T02:55:21.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-07-18T02:55:21.630 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-18T02:55:21.631 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-18T02:55:21.631 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-18T02:55:21.631 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-18T02:55:21.632 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-07-18T02:55:21.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:55:21.666 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:55:21.842 INFO:teuthology.dispatcher.supervisor:Running job 7342737 2023-07-18T02:55:21.843 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342737 --name rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342737/orig.config.yaml 2023-07-18T02:55:21.848 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342737 2023-07-18T02:55:21.849 INFO:teuthology.dispatcher.supervisor:Job PID: 31426 2023-07-18T02:55:21.849 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-18T02:57:21.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:57:21.950 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T02:59:22.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T02:59:22.212 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:01:22.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:01:22.389 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:03:22.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:03:22.561 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:05:22.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:05:22.729 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:07:22.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:07:22.901 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:09:23.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:09:23.069 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:11:28.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:11:28.234 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:13:28.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:13:28.422 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:15:28.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:15:28.602 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:17:28.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:17:28.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:19:28.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:19:28.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:21:29.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:21:29.123 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:23:29.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:23:29.302 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:25:29.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:25:29.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:27:29.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:27:29.649 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:29:29.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:29:29.816 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:31:29.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:31:29.982 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:33:30.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:33:30.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:35:30.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:35:30.321 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:37:30.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:37:30.486 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:39:30.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:39:30.658 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:41:30.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:41:30.841 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:43:31.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-18T03:43:31.006 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-18T03:43:31.079 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-18T03:43:31.295 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-18T03:43:31.295 INFO:teuthology.nuke:Checking targets against current locks 2023-07-18T03:43:31.347 DEBUG:teuthology.nuke:shortname: smithi003 2023-07-18T03:43:31.348 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T03:43:31.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 02:50:14.845843', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-18T03:43:31.375 DEBUG:teuthology.nuke:shortname: smithi008 2023-07-18T03:43:31.375 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T03:43:31.393 DEBUG:teuthology.nuke:shortname: smithi033 2023-07-18T03:43:31.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-18T03:43:31.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 02:50:14.842362', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-18T03:43:31.416 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-18_02:11:50-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7342737', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-18 02:50:14.844605', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-18T03:43:31.430 INFO:teuthology.orchestra.console:Power off smithi003 2023-07-18T03:43:31.431 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T03:43:31.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T03:43:31.470 INFO:teuthology.orchestra.console:Power off smithi008 2023-07-18T03:43:31.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T03:43:31.486 INFO:teuthology.orchestra.console:Power off smithi033 2023-07-18T03:43:31.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-18T03:43:31.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T03:43:31.510 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-18T03:43:31.595 INFO:teuthology.orchestra.console:Power off for smithi003 completed 2023-07-18T03:43:31.620 INFO:teuthology.orchestra.console:Power off for smithi008 completed 2023-07-18T03:43:31.632 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-07-18T03:43:31.752 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-07-18T03:43:31.778 INFO:teuthology.lock.ops:unlocked: smithi008.front.sepia.ceph.com 2023-07-18T03:43:31.785 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com