2023-07-21T18:49:34.891 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T18:49:34.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:49:34.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:49:35.068 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f003cece8b0>, signals=[15]) 2023-07-21T18:49:35.069 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-07-21T18:49:35.070 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:49:35.070 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-07-21T18:49:35.097 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-07-21T18:49:35.097 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:49:35.098 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-21T18:49:35.099 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-07-21T18:49:35.122 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-07-21T18:49:35.122 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:49:35.122 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-07-21T18:49:35.123 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-07-21T18:49:35.147 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"} 2023-07-21T18:49:35.196 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T18:49:35.217 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T18:49:35.236 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T18:49:35.236 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 5} 2023-07-21T18:49:35.256 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-21T18:49:35.260 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T18:49:35.260 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 5} 2023-07-21T18:49:35.280 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-07-21T18:49:35.280 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:49:35.292 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-21T18:49:35.293 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 5} 2023-07-21T18:49:35.298 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.6 2023-07-21T18:49:35.299 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:49:35.317 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:49:35.331 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:49:35.333 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of rhel 8.6 2023-07-21T18:49:35.333 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:49:35.350 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-07-21T18:49:35.365 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1} 2023-07-21T18:49:35.367 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:49:35.397 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-07-21T18:49:35.430 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:49:35.447 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:49:35.452 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:49:35.520 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-21T18:49:35.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:49:35.534 INFO:teuthology.orchestra.console:Power off smithi002 2023-07-21T18:49:35.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:49:35.545 INFO:teuthology.orchestra.console:Power off smithi117 2023-07-21T18:49:35.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:49:35.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:35.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:35.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:35.680 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-21T18:49:35.684 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-07-21T18:49:35.690 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-07-21T18:49:35.782 INFO:teuthology.orchestra.console:Power on smithi083 2023-07-21T18:49:35.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:49:35.790 INFO:teuthology.orchestra.console:Power on smithi002 2023-07-21T18:49:35.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:49:35.798 INFO:teuthology.orchestra.console:Power on smithi117 2023-07-21T18:49:35.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:49:35.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:35.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:35.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:39.838 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:39.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:39.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:40.067 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2023-07-21T18:49:40.168 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-07-21T18:49:40.169 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:49:43.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:43.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:49:44.165 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-07-21T18:49:44.172 INFO:teuthology.orchestra.console:Power on for smithi002 completed 2023-07-21T18:49:44.267 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-07-21T18:49:44.267 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:49:44.273 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-07-21T18:49:44.274 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:49:55.228 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:49:59.329 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:49:59.331 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:50:10.285 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:50:14.380 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:50:14.385 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:50:25.344 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:50:29.432 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:50:29.433 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:50:40.400 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:50:44.480 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:50:44.481 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:50:55.456 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:50:59.532 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:50:59.535 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:51:10.516 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:51:14.586 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:51:14.588 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:51:25.576 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:51:29.640 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:51:29.642 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:51:40.632 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:51:44.704 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:51:44.706 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:51:55.692 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:51:59.756 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:51:59.757 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:52:10.748 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:52:14.808 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:52:14.816 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-07-21T18:52:14.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:17.936 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-07-21T18:52:23.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:25.806 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-07-21T18:52:25.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:26.992 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-07-21T18:52:28.912 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T18:52:29.862 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-21T18:52:29.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:32.980 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-21T18:52:32.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:34.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:36.048 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-07-21T18:52:37.968 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T18:52:38.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:42.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:42.068 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-21T18:52:43.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:45.104 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-07-21T18:52:47.024 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T18:52:48.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:51.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:51.124 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-21T18:52:53.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:52:54.160 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-07-21T18:52:56.080 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T18:52:57.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:00.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:00.212 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-21T18:53:02.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:03.216 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-07-21T18:53:05.136 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T18:53:06.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:09.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:09.264 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-21T18:53:11.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:14.192 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-07-21T18:53:15.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:18.320 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-21T18:53:20.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:53:24.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:09.264 WARNING:teuthology.provision.fog.smithi002:timed out 2023-07-21T18:54:15.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:15.592 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T18:54:15.593 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T18:54:15.933 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-07-21T18:54:15.934 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-07-21T18:54:15.952 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-07-21T18:54:15.953 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-07-21T18:54:16.011 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-07-21T18:54:16.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-07-21T18:54:16.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-07-21T18:54:16.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-07-21T18:54:16.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-07-21T18:54:16.290 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-07-21T18:54:16.358 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-07-21T18:54:16.415 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T18:54:16.416 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T18:54:16.416 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-07-21T18:54:16.416 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-07-21T18:54:16.416 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-07-21T18:54:16.416 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T18:54:16.417 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-07-21T18:54:16.418 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T18:54:16.418 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T18:54:16.418 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T18:54:16.418 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T18:54:16.419 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-07-21T18:54:16.420 DEBUG:teuthology.parallel:result is None 2023-07-21T18:54:20.197 WARNING:teuthology.provision.fog.smithi117:timed out 2023-07-21T18:54:24.325 WARNING:teuthology.provision.fog.smithi083:timed out 2023-07-21T18:54:26.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:26.753 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T18:54:26.753 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T18:54:27.042 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-07-21T18:54:27.043 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2023-07-21T18:54:27.060 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2023-07-21T18:54:27.061 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2023-07-21T18:54:27.118 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-07-21T18:54:27.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-07-21T18:54:27.239 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2023-07-21T18:54:27.267 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2023-07-21T18:54:27.333 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2023-07-21T18:54:27.400 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-07-21T18:54:27.466 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-07-21T18:54:27.521 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T18:54:27.522 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T18:54:27.522 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2023-07-21T18:54:27.522 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2023-07-21T18:54:27.522 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2023-07-21T18:54:27.522 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-07-21T18:54:27.522 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-21T18:54:27.523 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T18:54:27.524 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T18:54:27.524 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T18:54:27.524 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T18:54:27.524 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-07-21T18:54:27.525 DEBUG:teuthology.parallel:result is None 2023-07-21T18:54:30.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:30.582 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T18:54:30.583 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T18:54:30.871 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-07-21T18:54:30.871 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-07-21T18:54:30.888 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-07-21T18:54:30.889 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-07-21T18:54:30.951 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-07-21T18:54:30.951 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-21T18:54:31.089 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-07-21T18:54:31.117 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-07-21T18:54:31.189 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-07-21T18:54:31.260 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-21T18:54:31.327 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-21T18:54:31.386 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T18:54:31.386 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T18:54:31.386 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-07-21T18:54:31.387 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-07-21T18:54:31.387 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-07-21T18:54:31.387 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-21T18:54:31.387 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T18:54:31.387 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T18:54:31.388 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T18:54:31.389 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T18:54:31.389 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T18:54:31.389 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-07-21T18:54:31.390 DEBUG:teuthology.parallel:result is None 2023-07-21T18:54:31.578 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-07-21T18:54:31.579 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T18:54:31.609 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-07-21T18:54:31.609 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T18:54:31.633 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2023-07-21T18:54:31.634 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T18:54:31.660 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-07-21T18:54:31.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-07-21T18:54:31.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:31.728 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-07-21T18:54:31.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-07-21T18:54:31.801 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-07-21T18:54:31.861 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-07-21T18:54:31.862 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-07-21T18:54:31.921 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T18:54:31.921 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T18:54:31.921 INFO:teuthology.orchestra.run.smithi002.stdout:ID="rhel" 2023-07-21T18:54:31.921 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="fedora" 2023-07-21T18:54:31.921 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8.6" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T18:54:31.922 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T18:54:31.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-07-21T18:54:31.923 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T18:54:31.923 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T18:54:31.923 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T18:54:31.923 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T18:54:31.924 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-07-21T18:54:31.950 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-07-21T18:54:31.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-21T18:54:31.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:32.018 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-21T18:54:32.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-21T18:54:32.091 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-07-21T18:54:32.149 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-07-21T18:54:32.150 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-21T18:54:32.208 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T18:54:32.208 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T18:54:32.208 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-07-21T18:54:32.208 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T18:54:32.209 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T18:54:32.210 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T18:54:32.210 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-07-21T18:54:32.210 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T18:54:32.210 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T18:54:32.210 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T18:54:32.210 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T18:54:32.211 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-21T18:54:32.233 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2023-07-21T18:54:32.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-07-21T18:54:32.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:54:32.299 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-07-21T18:54:32.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-07-21T18:54:32.368 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-07-21T18:54:32.427 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-07-21T18:54:32.428 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-07-21T18:54:32.485 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T18:54:32.486 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T18:54:32.486 INFO:teuthology.orchestra.run.smithi117.stdout:ID="rhel" 2023-07-21T18:54:32.486 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="fedora" 2023-07-21T18:54:32.486 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8.6" 2023-07-21T18:54:32.486 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2023-07-21T18:54:32.486 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout: 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T18:54:32.487 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T18:54:32.488 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T18:54:32.488 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T18:54:32.488 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-07-21T18:54:32.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:54:32.517 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:54:32.612 INFO:teuthology.dispatcher.supervisor:Running job 7346882 2023-07-21T18:54:32.612 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346882 --name rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346882/orig.config.yaml 2023-07-21T18:54:32.615 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346882 2023-07-21T18:54:32.616 INFO:teuthology.dispatcher.supervisor:Job PID: 18364 2023-07-21T18:54:32.616 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T18:56:32.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:56:32.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:58:32.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:58:32.771 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:00:32.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:00:32.946 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:02:33.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:02:33.117 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:04:33.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:04:33.281 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:06:33.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:06:33.462 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:08:33.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:08:33.637 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:10:33.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:10:33.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:12:33.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:12:33.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:14:34.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:14:34.113 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:16:34.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:16:34.255 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:18:34.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:18:34.434 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:20:34.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:20:34.599 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:22:34.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:22:34.769 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:24:34.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:24:34.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:26:35.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:26:35.125 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:28:35.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:28:35.296 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:30:35.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:30:35.496 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:32:35.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:32:35.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:34:36.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:34:36.051 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:36:36.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:36:36.232 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:38:36.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:38:36.398 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:40:36.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:40:36.569 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:42:36.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:42:36.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:44:36.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:44:36.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:46:37.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:46:37.070 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:48:37.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:48:37.246 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:50:37.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:50:37.420 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:52:37.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:52:37.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:54:37.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:54:37.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:56:37.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:56:37.943 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T19:58:38.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T19:58:38.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:00:38.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:00:38.289 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:02:38.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T20:02:38.465 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T20:02:38.552 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T20:02:38.784 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T20:02:38.785 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T20:02:38.842 DEBUG:teuthology.nuke:shortname: smithi002 2023-07-21T20:02:38.843 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T20:02:38.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:49:34.040879', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T20:02:38.871 DEBUG:teuthology.nuke:shortname: smithi083 2023-07-21T20:02:38.871 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T20:02:38.895 DEBUG:teuthology.nuke:shortname: smithi117 2023-07-21T20:02:38.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T20:02:38.902 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:49:34.042285', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T20:02:38.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346882', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:49:34.039100', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T20:02:38.932 INFO:teuthology.orchestra.console:Power off smithi002 2023-07-21T20:02:38.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T20:02:38.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T20:02:38.975 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-21T20:02:38.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T20:02:38.995 INFO:teuthology.orchestra.console:Power off smithi117 2023-07-21T20:02:38.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T20:02:39.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T20:02:39.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T20:02:39.105 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-07-21T20:02:39.130 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-21T20:02:39.142 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-07-21T20:02:39.260 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-07-21T20:02:39.286 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-07-21T20:02:39.293 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com