2023-07-09T01:20:40.154 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T01:20:40.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:20:40.156 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:20:40.352 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa22a0b5ee0>, signals=[15]) 2023-07-09T01:20:40.354 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-07-09T01:20:40.354 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T01:20:40.354 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-07-09T01:20:40.381 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-07-09T01:20:40.381 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T01:20:40.382 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-07-09T01:20:40.383 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"} 2023-07-09T01:20:40.405 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2023-07-09T01:20:40.406 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T01:20:40.406 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-09T01:20:40.407 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-07-09T01:20:40.430 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"} 2023-07-09T01:20:40.456 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T01:20:40.475 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T01:20:40.498 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T01:20:40.498 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 5} 2023-07-09T01:20:40.502 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T01:20:40.527 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T01:20:40.527 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 5} 2023-07-09T01:20:40.541 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T01:20:40.541 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 5} 2023-07-09T01:20:40.554 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.6 2023-07-09T01:20:40.554 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:20:40.570 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.6 2023-07-09T01:20:40.570 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:20:40.584 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.6 2023-07-09T01:20:40.584 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:20:40.628 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T01:20:40.637 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T01:20:40.644 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T01:20:40.666 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1} 2023-07-09T01:20:40.675 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-07-09T01:20:40.680 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1} 2023-07-09T01:20:40.729 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:20:40.731 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:20:40.734 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:20:40.846 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-09T01:20:40.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T01:20:40.864 INFO:teuthology.orchestra.console:Power off smithi136 2023-07-09T01:20:40.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T01:20:40.880 INFO:teuthology.orchestra.console:Power off smithi110 2023-07-09T01:20:40.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T01:20:40.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:40.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:40.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:44.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:44.933 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:44.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:49.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:49.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:49.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:49.256 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-09T01:20:49.265 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-07-09T01:20:49.358 INFO:teuthology.orchestra.console:Power on smithi193 2023-07-09T01:20:49.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T01:20:49.368 INFO:teuthology.orchestra.console:Power on smithi110 2023-07-09T01:20:49.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T01:20:49.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:49.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:53.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:53.363 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2023-07-09T01:20:53.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:53.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:53.464 INFO:teuthology.orchestra.console:Power on smithi136 2023-07-09T01:20:53.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T01:20:53.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:57.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:57.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:57.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T01:20:57.724 INFO:teuthology.orchestra.console:Power on for smithi136 completed 2023-07-09T01:20:57.732 INFO:teuthology.orchestra.console:Power on for smithi193 completed 2023-07-09T01:20:57.739 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2023-07-09T01:20:57.825 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-07-09T01:20:57.826 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:20:57.833 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2023-07-09T01:20:57.834 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:20:57.840 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-07-09T01:20:57.840 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:21:12.908 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:21:12.912 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:21:12.914 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:21:28.014 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:21:28.016 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:21:28.017 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:21:43.104 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:21:43.106 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:21:43.107 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:21:58.201 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:21:58.203 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:21:58.204 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:22:13.281 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:22:13.282 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:22:13.284 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:22:28.374 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:22:28.376 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:22:28.377 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:22:43.456 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:22:43.458 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:22:43.459 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:22:58.560 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:22:58.562 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:22:58.563 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:23:13.650 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:23:13.651 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:23:13.652 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:23:28.729 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:23:28.738 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:23:28.743 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:23:43.818 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None 2023-07-09T01:23:43.820 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-07-09T01:23:43.821 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None 2023-07-09T01:23:43.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:23:43.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:23:43.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:23:46.960 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-07-09T01:23:46.961 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-07-09T01:23:46.961 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-09T01:23:52.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:23:52.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:23:52.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:23:56.016 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-07-09T01:23:56.017 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-07-09T01:23:56.017 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-09T01:24:02.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:02.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:02.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:05.072 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-07-09T01:24:05.073 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-07-09T01:24:05.073 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-09T01:24:11.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:11.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:11.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:14.128 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-07-09T01:24:14.129 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-09T01:24:14.129 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-07-09T01:24:20.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:20.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:20.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:23.216 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-09T01:24:23.217 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-07-09T01:24:23.217 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-07-09T01:24:29.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:29.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:29.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:32.304 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2023-07-09T01:24:32.305 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-07-09T01:24:32.305 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-07-09T01:24:38.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:38.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:24:38.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:38.368 WARNING:teuthology.provision.fog.smithi193:timed out 2023-07-09T01:25:38.369 WARNING:teuthology.provision.fog.smithi136:timed out 2023-07-09T01:25:38.370 WARNING:teuthology.provision.fog.smithi110:timed out 2023-07-09T01:25:44.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:44.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:44.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:44.697 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T01:25:44.698 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T01:25:44.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T01:25:44.710 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T01:25:44.735 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T01:25:44.735 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T01:25:44.983 INFO:teuthology.provision.fog.smithi193:Node is ready 2023-07-09T01:25:44.983 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2023-07-09T01:25:45.001 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193 2023-07-09T01:25:45.001 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193 /etc/hosts 2023-07-09T01:25:45.005 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-07-09T01:25:45.005 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-07-09T01:25:45.008 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-07-09T01:25:45.008 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-07-09T01:25:45.022 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136 2023-07-09T01:25:45.023 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136 /etc/hosts 2023-07-09T01:25:45.024 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110 2023-07-09T01:25:45.025 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110 /etc/hosts 2023-07-09T01:25:45.056 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-07-09T01:25:45.057 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-09T01:25:45.080 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-07-09T01:25:45.080 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-07-09T01:25:45.086 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-07-09T01:25:45.086 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-07-09T01:25:45.176 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193/smithi193/g' /etc/hosts 2023-07-09T01:25:45.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hosts 2023-07-09T01:25:45.204 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2023-07-09T01:25:45.209 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110/smithi110/g' /etc/hosts 2023-07-09T01:25:45.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-07-09T01:25:45.236 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-07-09T01:25:45.270 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193/smithi193/g' /etc/hostname 2023-07-09T01:25:45.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hostname 2023-07-09T01:25:45.307 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110/smithi110/g' /etc/hostname 2023-07-09T01:25:45.336 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2023-07-09T01:25:45.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-07-09T01:25:45.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-07-09T01:25:45.400 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-09T01:25:45.422 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-07-09T01:25:45.447 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-07-09T01:25:45.453 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T01:25:45.454 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T01:25:45.455 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T01:25:45.456 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T01:25:45.456 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T01:25:45.456 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2023-07-09T01:25:45.458 DEBUG:teuthology.parallel:result is None 2023-07-09T01:25:45.478 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T01:25:45.478 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-07-09T01:25:45.479 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T01:25:45.480 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T01:25:45.481 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T01:25:45.481 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-07-09T01:25:45.482 DEBUG:teuthology.parallel:result is None 2023-07-09T01:25:45.507 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T01:25:45.508 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T01:25:45.508 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-07-09T01:25:45.508 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-07-09T01:25:45.508 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2023-07-09T01:25:45.508 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-07-09T01:25:45.508 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-07-09T01:25:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T01:25:45.510 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T01:25:45.510 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T01:25:45.510 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T01:25:45.510 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-07-09T01:25:45.511 DEBUG:teuthology.parallel:result is None 2023-07-09T01:25:45.700 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-07-09T01:25:45.701 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-09T01:25:45.719 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-07-09T01:25:45.719 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-09T01:25:45.735 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2023-07-09T01:25:45.736 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-09T01:25:45.761 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-07-09T01:25:45.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-07-09T01:25:45.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:45.831 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-07-09T01:25:45.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-07-09T01:25:45.896 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-07-09T01:25:45.955 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-07-09T01:25:45.956 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-07-09T01:25:46.015 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T01:25:46.016 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T01:25:46.016 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2023-07-09T01:25:46.016 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2023-07-09T01:25:46.016 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2023-07-09T01:25:46.016 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T01:25:46.017 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-07-09T01:25:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T01:25:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T01:25:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T01:25:46.018 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T01:25:46.019 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-07-09T01:25:46.044 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-07-09T01:25:46.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-07-09T01:25:46.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:46.109 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-07-09T01:25:46.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-07-09T01:25:46.181 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-07-09T01:25:46.237 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-07-09T01:25:46.238 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-07-09T01:25:46.298 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T01:25:46.298 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2023-07-09T01:25:46.299 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout: 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T01:25:46.300 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T01:25:46.301 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T01:25:46.301 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-07-09T01:25:46.327 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2023-07-09T01:25:46.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-09T01:25:46.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T01:25:46.392 DEBUG:teuthology.orchestra.run.smithi193:> true 2023-07-09T01:25:46.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2023-07-09T01:25:46.464 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2023-07-09T01:25:46.521 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2023-07-09T01:25:46.522 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2023-07-09T01:25:46.578 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T01:25:46.578 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T01:25:46.578 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel" 2023-07-09T01:25:46.578 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora" 2023-07-09T01:25:46.579 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6" 2023-07-09T01:25:46.579 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8" 2023-07-09T01:25:46.579 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T01:25:46.579 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2023-07-09T01:25:46.579 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T01:25:46.579 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout: 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T01:25:46.580 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T01:25:46.581 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2023-07-09T01:25:46.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:25:46.611 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:25:46.725 INFO:teuthology.dispatcher.supervisor:Running job 7331239 2023-07-09T01:25:46.725 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331239 --name rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331239/orig.config.yaml 2023-07-09T01:25:46.729 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331239 2023-07-09T01:25:46.730 INFO:teuthology.dispatcher.supervisor:Job PID: 20013 2023-07-09T01:25:46.730 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-09T01:27:46.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:27:46.832 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:29:47.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:29:47.018 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:31:47.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:31:47.188 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:33:47.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:33:47.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:35:47.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:35:47.521 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:37:47.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:37:47.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:39:47.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:39:47.872 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:41:48.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:41:48.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:43:48.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:43:48.215 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:45:48.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:45:48.397 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:47:48.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:47:48.537 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:49:48.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:49:48.717 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:51:48.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:51:48.901 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:53:49.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:53:49.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:55:49.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:55:49.247 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:57:49.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:57:49.422 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T01:59:49.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T01:59:49.609 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:01:49.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:01:49.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:03:49.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:03:49.965 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:05:50.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:05:50.140 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:07:50.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:07:50.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:09:50.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:09:50.514 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:11:50.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:11:50.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:13:50.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:13:50.878 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:15:51.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:15:51.062 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:17:51.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:17:51.242 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:19:51.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:19:51.411 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:21:51.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T02:21:51.582 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T02:21:51.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-09T02:21:51.859 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-09T02:21:51.859 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T02:21:51.914 DEBUG:teuthology.nuke:shortname: smithi110 2023-07-09T02:21:51.914 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T02:21:51.938 DEBUG:teuthology.nuke:shortname: smithi136 2023-07-09T02:21:51.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T02:21:51.941 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:20:39.290940', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T02:21:51.960 DEBUG:teuthology.nuke:shortname: smithi193 2023-07-09T02:21:51.961 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T02:21:51.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:20:39.289918', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T02:21:51.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 01:20:39.288674', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T02:21:51.995 INFO:teuthology.orchestra.console:Power off smithi110 2023-07-09T02:21:51.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:21:52.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:21:52.034 INFO:teuthology.orchestra.console:Power off smithi136 2023-07-09T02:21:52.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:21:52.050 INFO:teuthology.orchestra.console:Power off smithi193 2023-07-09T02:21:52.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T02:21:52.061 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:21:52.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T02:21:52.160 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2023-07-09T02:21:52.182 INFO:teuthology.orchestra.console:Power off for smithi136 completed 2023-07-09T02:21:52.194 INFO:teuthology.orchestra.console:Power off for smithi193 completed 2023-07-09T02:21:52.327 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2023-07-09T02:21:52.333 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com 2023-07-09T02:21:52.343 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com