2023-06-19T20:31:33.946 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-19T20:31:33.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:31:33.948 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:31:34.138 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d90fc25e0>, signals=[15]) 2023-06-19T20:31:34.140 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-06-19T20:31:34.141 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-06-19T20:31:34.141 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-06-19T20:31:34.161 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-06-19T20:31:34.161 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-06-19T20:31:34.162 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-06-19T20:31:34.163 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"} 2023-06-19T20:31:34.186 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging 2023-06-19T20:31:34.186 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server 2023-06-19T20:31:34.186 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2023-06-19T20:31:34.187 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-06-19T20:31:34.211 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /host {"name": "smithi171"} 2023-06-19T20:31:34.251 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-19T20:31:34.253 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-19T20:31:34.265 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-19T20:31:34.303 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-19T20:31:34.304 DEBUG:teuthology.provision.fog.smithi171:FOG request: PUT /host/276 {"imageID": 5} 2023-06-19T20:31:34.306 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-19T20:31:34.307 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 5} 2023-06-19T20:31:34.308 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-19T20:31:34.308 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 5} 2023-06-19T20:31:34.349 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of rhel 8.6 2023-06-19T20:31:34.350 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:31:34.352 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of rhel 8.6 2023-06-19T20:31:34.352 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:31:34.354 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6 2023-06-19T20:31:34.355 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:31:34.410 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /tasktype {"name": "deploy"} 2023-06-19T20:31:34.412 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"} 2023-06-19T20:31:34.415 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-06-19T20:31:34.448 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1} 2023-06-19T20:31:34.451 DEBUG:teuthology.provision.fog.smithi171:FOG request: POST /host/276/task {"taskTypeID": 1} 2023-06-19T20:31:34.458 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-06-19T20:31:34.505 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:31:34.518 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:31:34.522 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:31:34.600 INFO:teuthology.orchestra.console:Power off smithi007 2023-06-19T20:31:34.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T20:31:34.617 INFO:teuthology.orchestra.console:Power off smithi038 2023-06-19T20:31:34.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T20:31:34.630 INFO:teuthology.orchestra.console:Power off smithi171 2023-06-19T20:31:34.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T20:31:34.639 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:34.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:34.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:34.781 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2023-06-19T20:31:34.882 INFO:teuthology.orchestra.console:Power on smithi171 2023-06-19T20:31:34.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-19T20:31:34.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:38.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:38.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:38.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:42.790 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:42.798 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:43.000 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2023-06-19T20:31:43.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:43.101 INFO:teuthology.orchestra.console:Power on smithi007 2023-06-19T20:31:43.102 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-19T20:31:43.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:43.248 INFO:teuthology.orchestra.console:Power on for smithi171 completed 2023-06-19T20:31:43.349 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2023-06-19T20:31:43.349 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:31:46.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:47.125 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-06-19T20:31:47.146 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:47.227 INFO:teuthology.orchestra.console:Power on smithi038 2023-06-19T20:31:47.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-19T20:31:47.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:51.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:51.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T20:31:51.475 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2023-06-19T20:31:51.483 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2023-06-19T20:31:51.577 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-06-19T20:31:51.577 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:31:51.585 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-06-19T20:31:51.585 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:31:58.432 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:32:06.652 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:32:06.653 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:32:13.512 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:32:21.724 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:32:21.727 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:32:28.585 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:32:36.793 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:32:36.794 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:32:43.652 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:32:51.870 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:32:51.872 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:32:58.728 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:33:06.944 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:33:06.956 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:33:13.810 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:33:22.016 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:33:22.026 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:33:28.884 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:33:37.084 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:33:37.085 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:33:43.952 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:33:52.156 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:33:52.157 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:33:59.028 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:34:07.224 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:34:07.225 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:34:14.092 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:34:22.292 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-06-19T20:34:22.293 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:34:22.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:34:22.646 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: Authentication failed. 2023-06-19T20:34:29.148 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:34:37.354 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-06-19T20:34:37.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:34:40.468 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-19T20:34:44.208 DEBUG:teuthology.provision.fog.smithi171:FOG request: GET /task/active None 2023-06-19T20:34:44.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:34:46.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:34:47.344 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:34:49.520 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-19T20:34:53.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:34:55.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:34:56.404 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:34:58.576 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-19T20:35:02.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:04.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:05.456 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:35:07.632 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-19T20:35:11.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:13.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:14.512 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:35:16.688 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-06-19T20:35:20.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:22.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:23.568 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:35:23.650 WARNING:teuthology.provision.fog.smithi007:timed out 2023-06-19T20:35:29.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:29.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:32.624 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:35:38.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:41.684 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-06-19T20:35:47.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:48.212 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-06-19T20:35:54.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:35:57.264 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-06-19T20:36:03.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:36:03.614 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-19T20:36:03.615 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-19T20:36:03.905 INFO:teuthology.provision.fog.smithi007:Node is ready 2023-06-19T20:36:03.905 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2023-06-19T20:36:03.922 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2023-06-19T20:36:03.923 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2023-06-19T20:36:03.982 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2023-06-19T20:36:03.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-06-19T20:36:04.092 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2023-06-19T20:36:04.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2023-06-19T20:36:04.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2023-06-19T20:36:04.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-06-19T20:36:04.336 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-06-19T20:36:04.396 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-06-19T20:36:04.396 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)" 2023-06-19T20:36:04.396 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-06-19T20:36:04.397 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-06-19T20:36:04.397 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6" 2023-06-19T20:36:04.397 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-06-19T20:36:04.397 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-19T20:36:04.397 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-19T20:36:04.398 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-19T20:36:04.399 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-19T20:36:04.399 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-19T20:36:04.400 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2023-06-19T20:36:04.401 DEBUG:teuthology.parallel:result is None 2023-06-19T20:36:22.691 WARNING:teuthology.provision.fog.smithi038:timed out 2023-06-19T20:36:28.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:36:29.020 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-19T20:36:29.020 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-19T20:36:29.318 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-06-19T20:36:29.318 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-06-19T20:36:29.336 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-06-19T20:36:29.338 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-06-19T20:36:29.394 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-06-19T20:36:29.395 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-06-19T20:36:29.505 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-06-19T20:36:29.534 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-06-19T20:36:29.603 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-06-19T20:36:29.670 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-06-19T20:36:29.737 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-06-19T20:36:29.794 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-06-19T20:36:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-06-19T20:36:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-06-19T20:36:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-06-19T20:36:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-06-19T20:36:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-06-19T20:36:29.795 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-19T20:36:29.796 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-06-19T20:36:29.796 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-19T20:36:29.796 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-06-19T20:36:29.796 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-19T20:36:29.796 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-19T20:36:29.796 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-19T20:36:29.797 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-19T20:36:29.797 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-19T20:36:29.797 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-19T20:36:29.797 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-19T20:36:29.797 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-06-19T20:36:29.798 DEBUG:teuthology.parallel:result is None 2023-06-19T20:36:47.687 WARNING:teuthology.provision.fog.smithi171:timed out 2023-06-19T20:36:53.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:36:54.036 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-19T20:36:54.036 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-19T20:36:54.307 INFO:teuthology.provision.fog.smithi171:Node is ready 2023-06-19T20:36:54.308 DEBUG:teuthology.orchestra.run.smithi171:> hostname 2023-06-19T20:36:54.366 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171 2023-06-19T20:36:54.367 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171 /etc/hosts 2023-06-19T20:36:54.425 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2023-06-19T20:36:54.425 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2023-06-19T20:36:54.528 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171/smithi171/g' /etc/hosts 2023-06-19T20:36:54.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts 2023-06-19T20:36:54.623 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171/smithi171/g' /etc/hostname 2023-06-19T20:36:54.690 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2023-06-19T20:36:54.756 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2023-06-19T20:36:54.813 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux" 2023-06-19T20:36:54.814 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.6 (Ootpa)" 2023-06-19T20:36:54.814 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel" 2023-06-19T20:36:54.814 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora" 2023-06-19T20:36:54.814 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.6" 2023-06-19T20:36:54.814 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2023-06-19T20:36:54.814 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-19T20:36:54.815 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-19T20:36:54.816 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-19T20:36:54.816 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-19T20:36:54.816 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2023-06-19T20:36:54.817 DEBUG:teuthology.parallel:result is None 2023-06-19T20:36:55.007 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2023-06-19T20:36:55.009 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-19T20:36:55.036 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-06-19T20:36:55.036 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-19T20:36:55.052 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2023-06-19T20:36:55.052 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-19T20:36:55.078 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2023-06-19T20:36:55.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-06-19T20:36:55.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:36:55.146 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-06-19T20:36:55.285 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-06-19T20:36:55.342 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-06-19T20:36:55.342 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-06-19T20:36:55.400 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-06-19T20:36:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)" 2023-06-19T20:36:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-06-19T20:36:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-06-19T20:36:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6" 2023-06-19T20:36:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-19T20:36:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-06-19T20:36:55.403 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-19T20:36:55.403 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-19T20:36:55.403 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-19T20:36:55.403 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-19T20:36:55.403 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-06-19T20:36:55.427 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-06-19T20:36:55.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-06-19T20:36:55.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:36:55.494 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-06-19T20:36:55.631 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-06-19T20:36:55.690 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-06-19T20:36:55.691 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-06-19T20:36:55.749 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="Red Hat Enterprise Linux" 2023-06-19T20:36:55.749 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8.6 (Ootpa)" 2023-06-19T20:36:55.749 INFO:teuthology.orchestra.run.smithi038.stdout:ID="rhel" 2023-06-19T20:36:55.749 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="fedora" 2023-06-19T20:36:55.749 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8.6" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://www.redhat.com/" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-19T20:36:55.750 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-19T20:36:55.751 INFO:teuthology.orchestra.run.smithi038.stdout: 2023-06-19T20:36:55.751 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-19T20:36:55.751 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-19T20:36:55.751 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-19T20:36:55.751 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-19T20:36:55.751 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-06-19T20:36:55.777 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2023-06-19T20:36:55.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2023-06-19T20:36:55.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T20:36:55.845 DEBUG:teuthology.orchestra.run.smithi171:> true 2023-06-19T20:36:55.916 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2023-06-19T20:36:55.975 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2023-06-19T20:36:55.975 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2023-06-19T20:36:56.035 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux" 2023-06-19T20:36:56.036 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.6 (Ootpa)" 2023-06-19T20:36:56.036 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel" 2023-06-19T20:36:56.036 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora" 2023-06-19T20:36:56.038 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.6" 2023-06-19T20:36:56.038 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2023-06-19T20:36:56.038 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-19T20:36:56.038 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/" 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-19T20:36:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-19T20:36:56.040 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-19T20:36:56.040 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-19T20:36:56.040 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2023-06-19T20:36:56.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:36:56.062 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:36:56.164 INFO:teuthology.dispatcher.supervisor:Running job 7307839 2023-06-19T20:36:56.164 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307839 --name rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307839/orig.config.yaml 2023-06-19T20:36:56.168 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307839 2023-06-19T20:36:56.169 INFO:teuthology.dispatcher.supervisor:Job PID: 29652 2023-06-19T20:36:56.170 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-19T20:38:56.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:38:56.172 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:40:56.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:40:56.255 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:42:56.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:42:56.339 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:44:56.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:44:56.405 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:46:56.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:46:56.487 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:48:56.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:48:56.561 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:50:56.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:50:56.645 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:52:56.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:52:56.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:54:56.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:54:56.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:56:56.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:56:56.858 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T20:58:56.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T20:58:56.940 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:00:57.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:00:57.055 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:02:57.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:02:57.128 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:04:57.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:04:57.204 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:06:57.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:06:57.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:08:57.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:08:57.365 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:10:57.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:10:57.445 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:12:57.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:12:57.515 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:14:57.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:14:57.589 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:16:57.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T21:16:57.664 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T21:16:57.734 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-19T21:16:57.888 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-19T21:16:57.889 INFO:teuthology.nuke:Checking targets against current locks 2023-06-19T21:16:57.933 DEBUG:teuthology.nuke:shortname: smithi007 2023-06-19T21:16:57.934 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-19T21:16:57.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-19 20:31:33.111587', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-19T21:16:57.967 DEBUG:teuthology.nuke:shortname: smithi038 2023-06-19T21:16:57.967 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-19T21:16:57.988 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-19 20:31:33.113057', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-19T21:16:57.992 DEBUG:teuthology.nuke:shortname: smithi171 2023-06-19T21:16:57.993 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-19T21:16:58.008 INFO:teuthology.orchestra.console:Power off smithi007 2023-06-19T21:16:58.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T21:16:58.019 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-19 20:31:33.114175', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-19T21:16:58.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T21:16:58.050 INFO:teuthology.orchestra.console:Power off smithi038 2023-06-19T21:16:58.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T21:16:58.067 INFO:teuthology.orchestra.console:Power off smithi171 2023-06-19T21:16:58.067 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T21:16:58.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T21:16:58.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T21:16:58.160 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2023-06-19T21:16:58.198 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2023-06-19T21:16:58.208 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2023-06-19T21:16:58.317 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-06-19T21:16:58.350 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-06-19T21:16:58.358 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com