2023-06-20T08:59:14.336 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T08:59:14.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T08:59:14.337 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T08:59:14.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1287a4a5e0>, signals=[15]) 2023-06-20T08:59:14.550 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-06-20T08:59:14.552 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T08:59:14.552 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-06-20T08:59:14.579 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-06-20T08:59:14.579 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T08:59:14.580 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-06-20T08:59:14.582 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-06-20T08:59:14.637 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-06-20T08:59:14.638 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T08:59:14.638 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-06-20T08:59:14.639 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-06-20T08:59:14.656 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T08:59:14.670 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-06-20T08:59:14.705 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T08:59:14.705 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 5} 2023-06-20T08:59:14.715 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T08:59:14.747 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-20T08:59:14.750 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6 2023-06-20T08:59:14.751 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T08:59:14.753 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T08:59:14.753 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 5} 2023-06-20T08:59:14.795 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-20T08:59:14.795 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 5} 2023-06-20T08:59:14.811 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-06-20T08:59:14.812 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T08:59:14.817 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T08:59:14.838 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6 2023-06-20T08:59:14.839 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T08:59:14.859 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T08:59:14.862 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-06-20T08:59:14.886 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T08:59:14.896 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-06-20T08:59:14.920 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-06-20T08:59:14.927 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T08:59:14.948 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T08:59:14.964 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T08:59:15.020 INFO:teuthology.orchestra.console:Power off smithi006 2023-06-20T08:59:15.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T08:59:15.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:15.070 INFO:teuthology.orchestra.console:Power off smithi083 2023-06-20T08:59:15.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T08:59:15.086 INFO:teuthology.orchestra.console:Power off smithi098 2023-06-20T08:59:15.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T08:59:15.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:15.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:19.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:19.131 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:19.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:23.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:23.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:23.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:23.423 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-06-20T08:59:23.455 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-06-20T08:59:23.474 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-06-20T08:59:23.524 INFO:teuthology.orchestra.console:Power on smithi006 2023-06-20T08:59:23.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T08:59:23.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:23.556 INFO:teuthology.orchestra.console:Power on smithi098 2023-06-20T08:59:23.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T08:59:23.575 INFO:teuthology.orchestra.console:Power on smithi083 2023-06-20T08:59:23.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T08:59:23.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:23.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:27.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:27.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:27.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:31.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:31.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:31.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T08:59:31.899 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2023-06-20T08:59:31.934 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2023-06-20T08:59:31.960 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-06-20T08:59:32.000 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-06-20T08:59:32.001 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T08:59:32.035 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-06-20T08:59:32.035 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T08:59:32.062 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-06-20T08:59:32.062 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T08:59:47.081 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T08:59:47.112 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T08:59:47.132 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:00:02.164 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:00:02.185 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:00:02.195 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:00:17.272 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:00:17.273 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:00:17.274 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:00:32.352 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:00:32.353 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:00:32.354 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:00:47.434 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:00:47.436 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:00:47.437 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:01:02.516 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:01:02.517 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:01:02.518 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:01:17.604 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:01:17.606 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:01:17.607 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:01:32.704 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:01:32.705 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:01:32.709 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:01:47.798 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:01:47.800 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:01:47.801 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:02:02.891 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-06-20T09:02:02.893 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:02:02.895 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-06-20T09:02:02.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:02.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:03.135 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: Authentication failed. 2023-06-20T09:02:06.036 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-20T09:02:12.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:15.092 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-20T09:02:17.975 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-20T09:02:18.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:21.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:21.136 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:02:24.148 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-20T09:02:27.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:30.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:30.192 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:02:33.200 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-20T09:02:36.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:39.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:39.248 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:02:42.256 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-20T09:02:45.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:48.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:48.304 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:02:51.312 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-06-20T09:02:54.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:57.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:02:57.360 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:03:03.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:03:04.139 WARNING:teuthology.provision.fog.smithi083:timed out 2023-06-20T09:03:06.416 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:03:10.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:03:12.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:03:15.472 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-20T09:03:21.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:03:28.628 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-06-20T09:03:34.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:03:37.680 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-06-20T09:03:43.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:03:44.043 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T09:03:44.044 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T09:03:44.365 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-06-20T09:03:44.365 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-06-20T09:03:44.380 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-06-20T09:03:44.381 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-06-20T09:03:44.436 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-06-20T09:03:44.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-06-20T09:03:44.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-06-20T09:03:44.638 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-06-20T09:03:44.704 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-06-20T09:03:44.771 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-06-20T09:03:44.837 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-06-20T09:03:44.893 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T09:03:44.893 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T09:03:44.894 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-06-20T09:03:44.894 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-06-20T09:03:44.894 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-06-20T09:03:44.894 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-06-20T09:03:44.894 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-06-20T09:03:44.895 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T09:03:44.896 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T09:03:44.896 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T09:03:44.896 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T09:03:44.897 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-06-20T09:03:44.898 DEBUG:teuthology.parallel:result is None 2023-06-20T09:03:57.315 WARNING:teuthology.provision.fog.smithi006:timed out 2023-06-20T09:04:03.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:04:03.664 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T09:04:03.665 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T09:04:03.976 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-06-20T09:04:03.976 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-06-20T09:04:03.994 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-06-20T09:04:03.995 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-06-20T09:04:04.053 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-06-20T09:04:04.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-06-20T09:04:04.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-06-20T09:04:04.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-06-20T09:04:04.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-06-20T09:04:04.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-06-20T09:04:04.409 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-06-20T09:04:04.466 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T09:04:04.466 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T09:04:04.466 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-06-20T09:04:04.466 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T09:04:04.467 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T09:04:04.468 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T09:04:04.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-06-20T09:04:04.468 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T09:04:04.468 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T09:04:04.468 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T09:04:04.468 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T09:04:04.469 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-06-20T09:04:04.469 DEBUG:teuthology.parallel:result is None 2023-06-20T09:04:21.475 WARNING:teuthology.provision.fog.smithi098:timed out 2023-06-20T09:04:27.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:04:27.702 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T09:04:27.702 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T09:04:27.971 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-06-20T09:04:27.971 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-06-20T09:04:27.989 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098 2023-06-20T09:04:27.989 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098 /etc/hosts 2023-06-20T09:04:28.048 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-06-20T09:04:28.048 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-06-20T09:04:28.169 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098/smithi098/g' /etc/hosts 2023-06-20T09:04:28.197 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-06-20T09:04:28.264 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098/smithi098/g' /etc/hostname 2023-06-20T09:04:28.333 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-06-20T09:04:28.399 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-06-20T09:04:28.456 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T09:04:28.457 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T09:04:28.457 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2023-06-20T09:04:28.457 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2023-06-20T09:04:28.457 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2023-06-20T09:04:28.457 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-06-20T09:04:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T09:04:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-06-20T09:04:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T09:04:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T09:04:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T09:04:28.458 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T09:04:28.459 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-06-20T09:04:28.459 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T09:04:28.459 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T09:04:28.459 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T09:04:28.459 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T09:04:28.459 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-06-20T09:04:28.460 DEBUG:teuthology.parallel:result is None 2023-06-20T09:04:28.646 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-06-20T09:04:28.647 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T09:04:28.676 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-06-20T09:04:28.677 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T09:04:28.701 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-06-20T09:04:28.701 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T09:04:28.727 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-06-20T09:04:28.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-06-20T09:04:28.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:04:28.795 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-06-20T09:04:28.872 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-06-20T09:04:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-06-20T09:04:28.932 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-06-20T09:04:28.992 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T09:04:28.992 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T09:04:28.992 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-06-20T09:04:28.992 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T09:04:28.993 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T09:04:28.994 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T09:04:28.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-06-20T09:04:28.994 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T09:04:28.994 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T09:04:28.994 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T09:04:28.994 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T09:04:28.995 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-06-20T09:04:29.026 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-06-20T09:04:29.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-06-20T09:04:29.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:04:29.093 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-06-20T09:04:29.230 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-06-20T09:04:29.288 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-06-20T09:04:29.288 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-06-20T09:04:29.345 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T09:04:29.346 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T09:04:29.346 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-06-20T09:04:29.346 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-06-20T09:04:29.346 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-06-20T09:04:29.346 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-06-20T09:04:29.346 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-06-20T09:04:29.347 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T09:04:29.348 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T09:04:29.348 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T09:04:29.348 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T09:04:29.348 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-06-20T09:04:29.384 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-06-20T09:04:29.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-06-20T09:04:29.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T09:04:29.451 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-06-20T09:04:29.517 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-06-20T09:04:29.575 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-06-20T09:04:29.575 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-06-20T09:04:29.633 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2023-06-20T09:04:29.633 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2023-06-20T09:04:29.633 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2023-06-20T09:04:29.633 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2023-06-20T09:04:29.633 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-20T09:04:29.634 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-20T09:04:29.635 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-06-20T09:04:29.635 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-20T09:04:29.635 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-20T09:04:29.635 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-20T09:04:29.635 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-20T09:04:29.636 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-06-20T09:04:29.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:04:29.660 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:04:29.783 INFO:teuthology.dispatcher.supervisor:Running job 7307912 2023-06-20T09:04:29.784 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307912 --name rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307912/orig.config.yaml 2023-06-20T09:04:29.788 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307912 2023-06-20T09:04:29.789 INFO:teuthology.dispatcher.supervisor:Job PID: 21462 2023-06-20T09:04:29.789 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T09:06:29.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:06:29.791 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:08:29.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:08:29.872 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:10:29.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:10:29.953 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:12:30.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:12:30.026 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:14:30.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:14:30.117 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:16:30.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:16:30.199 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:18:30.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:18:30.280 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:20:30.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:20:30.343 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:22:30.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:22:30.419 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:24:30.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:24:30.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:26:30.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:26:30.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:28:30.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:28:30.648 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:30:30.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:30:30.722 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:32:30.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:32:30.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:34:30.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:34:30.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:36:30.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:36:30.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:38:31.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:38:31.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:40:31.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:40:31.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:42:31.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:42:31.200 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:44:31.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:44:31.281 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:46:31.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:46:31.365 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:48:31.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:48:31.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:50:31.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:50:31.519 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:52:31.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:52:31.597 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:54:31.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:54:31.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:56:31.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:56:31.760 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T09:58:31.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T09:58:31.836 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T10:00:31.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T10:00:31.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T10:02:31.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T10:02:31.991 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T10:04:32.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T10:04:32.061 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T10:04:32.144 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T10:04:32.405 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-20T10:04:32.405 INFO:teuthology.nuke:Checking targets against current locks 2023-06-20T10:04:32.463 DEBUG:teuthology.nuke:shortname: smithi006 2023-06-20T10:04:32.464 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T10:04:32.500 DEBUG:teuthology.nuke:shortname: smithi083 2023-06-20T10:04:32.500 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T10:04:32.503 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 08:59:13.486634', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-20T10:04:32.527 DEBUG:teuthology.nuke:shortname: smithi098 2023-06-20T10:04:32.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-20T10:04:32.534 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 08:59:13.482584', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-20T10:04:32.556 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-19_18:26:08-fs-wip-rishabh-2023June18-testing-default-smithi/7307912', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-20 08:59:13.484880', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-20T10:04:32.573 INFO:teuthology.orchestra.console:Power off smithi006 2023-06-20T10:04:32.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T10:04:32.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T10:04:32.619 INFO:teuthology.orchestra.console:Power off smithi083 2023-06-20T10:04:32.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T10:04:32.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T10:04:32.670 INFO:teuthology.orchestra.console:Power off smithi098 2023-06-20T10:04:32.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T10:04:32.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T10:04:32.733 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-06-20T10:04:32.780 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-06-20T10:04:32.814 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-06-20T10:04:32.893 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-06-20T10:04:32.934 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-06-20T10:04:32.977 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com