2023-07-20T02:02:18.498 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T02:02:18.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:02:18.500 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:02:18.694 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feaec9ad8b0>, signals=[15]) 2023-07-20T02:02:18.696 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-07-20T02:02:18.697 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:02:18.697 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-20T02:02:18.716 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-07-20T02:02:18.717 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:02:18.717 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-20T02:02:18.719 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-07-20T02:02:18.740 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-07-20T02:02:18.740 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T02:02:18.741 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-07-20T02:02:18.742 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-07-20T02:02:18.765 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"} 2023-07-20T02:02:18.805 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:02:18.811 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:02:18.827 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T02:02:18.850 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:02:18.850 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 5} 2023-07-20T02:02:18.853 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:02:18.853 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5} 2023-07-20T02:02:18.868 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T02:02:18.868 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 5} 2023-07-20T02:02:18.891 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.6 2023-07-20T02:02:18.891 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:02:18.896 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6 2023-07-20T02:02:18.896 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:02:18.910 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of rhel 8.6 2023-07-20T02:02:18.911 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:02:18.937 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:02:18.940 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:02:18.949 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T02:02:18.973 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-07-20T02:02:18.977 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-07-20T02:02:18.979 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1} 2023-07-20T02:02:19.032 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:02:19.035 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:02:19.038 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:02:19.118 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-20T02:02:19.119 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:02:19.137 INFO:teuthology.orchestra.console:Power off smithi204 2023-07-20T02:02:19.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:02:19.150 INFO:teuthology.orchestra.console:Power off smithi092 2023-07-20T02:02:19.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:02:19.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:19.173 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:19.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:19.293 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2023-07-20T02:02:19.296 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-20T02:02:19.305 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-07-20T02:02:19.394 INFO:teuthology.orchestra.console:Power on smithi204 2023-07-20T02:02:19.394 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:02:19.405 INFO:teuthology.orchestra.console:Power on smithi145 2023-07-20T02:02:19.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:02:19.416 INFO:teuthology.orchestra.console:Power on smithi092 2023-07-20T02:02:19.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T02:02:19.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:19.435 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:19.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:23.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:23.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:23.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:27.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:27.585 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:27.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:02:27.787 INFO:teuthology.orchestra.console:Power on for smithi204 completed 2023-07-20T02:02:27.799 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-07-20T02:02:27.810 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2023-07-20T02:02:27.889 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-07-20T02:02:27.889 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:02:27.900 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-07-20T02:02:27.901 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:02:27.911 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-07-20T02:02:27.912 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:02:42.972 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:02:42.973 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:02:42.974 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:02:58.045 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:02:58.047 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:02:58.049 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:03:13.124 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:03:13.125 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:03:13.127 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:03:28.196 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:03:28.197 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:03:28.198 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:03:43.272 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:03:43.273 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:03:43.274 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:03:58.344 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:03:58.345 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:03:58.346 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:04:13.418 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:04:13.420 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:04:13.421 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:04:28.506 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:04:28.507 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:04:28.508 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:04:43.588 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:04:43.589 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:04:43.590 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:04:58.662 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:04:58.663 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:04:58.664 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:05:13.736 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-07-20T02:05:13.737 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-20T02:05:13.738 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-07-20T02:05:13.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:13.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:13.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:16.852 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-20T02:05:16.853 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-20T02:05:16.884 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:05:22.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:22.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:22.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:25.936 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-20T02:05:25.937 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-20T02:05:25.938 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:05:31.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:31.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:31.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:34.992 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-20T02:05:34.993 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-20T02:05:34.994 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:05:40.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:40.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:40.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:44.048 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-20T02:05:44.049 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-20T02:05:44.080 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:05:50.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:50.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:50.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:53.104 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-20T02:05:53.105 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-07-20T02:05:53.136 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:05:59.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:59.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:05:59.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:06:02.160 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-20T02:06:02.192 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:06:08.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:06:08.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:06:11.248 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-07-20T02:06:17.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:06:59.152 WARNING:teuthology.provision.fog.smithi145:timed out 2023-07-20T02:07:05.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:07:05.506 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:07:05.508 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:07:05.830 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-07-20T02:07:05.831 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-07-20T02:07:05.849 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2023-07-20T02:07:05.850 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2023-07-20T02:07:05.907 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-07-20T02:07:05.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-20T02:07:06.026 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2023-07-20T02:07:06.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-07-20T02:07:06.123 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2023-07-20T02:07:06.190 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-07-20T02:07:06.256 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-20T02:07:06.312 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:07:06.312 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-20T02:07:06.313 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:07:06.314 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:07:06.315 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:07:06.315 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-07-20T02:07:06.317 DEBUG:teuthology.parallel:result is None 2023-07-20T02:07:08.168 WARNING:teuthology.provision.fog.smithi092:timed out 2023-07-20T02:07:14.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:07:14.493 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:07:14.494 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:07:14.774 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-07-20T02:07:14.775 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-07-20T02:07:14.794 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-07-20T02:07:14.795 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-07-20T02:07:14.854 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-07-20T02:07:14.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-07-20T02:07:14.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-07-20T02:07:15.009 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-07-20T02:07:15.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-07-20T02:07:15.152 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-07-20T02:07:15.222 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-20T02:07:15.279 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:07:15.280 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:07:15.280 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-07-20T02:07:15.280 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-07-20T02:07:15.280 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-07-20T02:07:15.280 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:07:15.280 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-20T02:07:15.281 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:07:15.282 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:07:15.282 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:07:15.282 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:07:15.282 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-07-20T02:07:15.283 DEBUG:teuthology.parallel:result is None 2023-07-20T02:07:17.256 WARNING:teuthology.provision.fog.smithi204:timed out 2023-07-20T02:07:23.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:07:23.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T02:07:23.594 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T02:07:23.879 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-07-20T02:07:23.879 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-07-20T02:07:23.897 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204 2023-07-20T02:07:23.898 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204 /etc/hosts 2023-07-20T02:07:23.955 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-07-20T02:07:23.956 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-07-20T02:07:24.088 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204/smithi204/g' /etc/hosts 2023-07-20T02:07:24.117 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-07-20T02:07:24.185 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204/smithi204/g' /etc/hostname 2023-07-20T02:07:24.253 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-07-20T02:07:24.321 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-07-20T02:07:24.378 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:07:24.378 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:07:24.378 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2023-07-20T02:07:24.378 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2023-07-20T02:07:24.379 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2023-07-20T02:07:24.379 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:07:24.379 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:07:24.379 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-07-20T02:07:24.379 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:07:24.379 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:07:24.380 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:07:24.380 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:07:24.380 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-07-20T02:07:24.380 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:07:24.380 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:07:24.381 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:07:24.381 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:07:24.382 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-07-20T02:07:24.382 DEBUG:teuthology.parallel:result is None 2023-07-20T02:07:24.579 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-07-20T02:07:24.580 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:07:24.605 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-07-20T02:07:24.606 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-20T02:07:24.630 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-07-20T02:07:24.632 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:07:24.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-20T02:07:24.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:07:24.704 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-20T02:07:24.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-20T02:07:24.735 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-07-20T02:07:24.795 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-07-20T02:07:24.795 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-20T02:07:24.855 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:07:24.855 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:07:24.855 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-07-20T02:07:24.855 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-07-20T02:07:24.855 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-07-20T02:07:24.856 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:07:24.856 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:07:24.856 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-07-20T02:07:24.856 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:07:24.856 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:07:24.856 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:07:24.857 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:07:24.857 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-20T02:07:24.857 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:07:24.857 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:07:24.857 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:07:24.858 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:07:24.858 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-20T02:07:24.880 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:07:24.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-20T02:07:24.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:07:24.949 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-07-20T02:07:25.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-07-20T02:07:25.079 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-07-20T02:07:25.136 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-07-20T02:07:25.137 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-07-20T02:07:25.195 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:07:25.196 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:07:25.196 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-07-20T02:07:25.196 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-07-20T02:07:25.196 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-07-20T02:07:25.196 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:07:25.197 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-07-20T02:07:25.198 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:07:25.198 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:07:25.198 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:07:25.198 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:07:25.198 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-07-20T02:07:25.221 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-07-20T02:07:25.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-07-20T02:07:25.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T02:07:25.288 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-07-20T02:07:25.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-07-20T02:07:25.354 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-07-20T02:07:25.411 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-07-20T02:07:25.411 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-07-20T02:07:25.468 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T02:07:25.468 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T02:07:25.468 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2023-07-20T02:07:25.468 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T02:07:25.469 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T02:07:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T02:07:25.470 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-07-20T02:07:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T02:07:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T02:07:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T02:07:25.470 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T02:07:25.471 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-07-20T02:07:25.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:07:25.490 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:07:25.585 INFO:teuthology.dispatcher.supervisor:Running job 7344288 2023-07-20T02:07:25.585 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344288 --name pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344288/orig.config.yaml 2023-07-20T02:07:25.589 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344288 2023-07-20T02:07:25.590 INFO:teuthology.dispatcher.supervisor:Job PID: 15494 2023-07-20T02:07:25.590 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-20T02:09:25.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:09:25.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:11:25.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:11:25.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:13:25.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:13:25.973 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:15:26.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:15:26.139 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:17:26.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:17:26.306 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:19:26.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:19:26.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:21:26.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:21:26.656 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:23:26.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:23:26.830 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:25:27.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:25:27.013 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:27:27.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:27:27.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:29:27.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:29:27.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:31:27.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:31:27.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:33:27.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:33:27.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:35:27.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:35:27.898 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:37:28.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:37:28.069 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:39:28.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:39:28.245 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:41:28.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:41:28.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:43:28.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:43:28.597 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:45:28.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:45:28.774 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:47:28.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:47:28.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:49:29.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T02:49:29.117 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T02:49:29.186 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-20T02:49:29.332 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-20T02:49:29.333 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T02:49:29.390 DEBUG:teuthology.nuke:shortname: smithi092 2023-07-20T02:49:29.391 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T02:49:29.413 DEBUG:teuthology.nuke:shortname: smithi145 2023-07-20T02:49:29.414 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T02:49:29.417 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:02:17.644230', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T02:49:29.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:02:17.646468', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-20T02:49:29.441 DEBUG:teuthology.nuke:shortname: smithi204 2023-07-20T02:49:29.441 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T02:49:29.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 02:02:17.648171', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-20T02:49:29.474 INFO:teuthology.orchestra.console:Power off smithi092 2023-07-20T02:49:29.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:49:29.492 INFO:teuthology.orchestra.console:Power off smithi145 2023-07-20T02:49:29.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:49:29.502 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:49:29.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:49:29.550 INFO:teuthology.orchestra.console:Power off smithi204 2023-07-20T02:49:29.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T02:49:29.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T02:49:29.635 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-07-20T02:49:29.641 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-07-20T02:49:29.696 INFO:teuthology.orchestra.console:Power off for smithi204 completed 2023-07-20T02:49:29.793 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2023-07-20T02:49:29.801 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com 2023-07-20T02:49:29.852 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com