2023-06-21T08:00:50.036 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-21T08:00:50.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:00:50.039 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:00:50.246 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbe358995e0>, signals=[15]) 2023-06-21T08:00:50.247 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2023-06-21T08:00:50.248 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T08:00:50.248 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-06-21T08:00:50.280 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-06-21T08:00:50.281 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T08:00:50.281 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-06-21T08:00:50.282 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"} 2023-06-21T08:00:50.305 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-06-21T08:00:50.305 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-06-21T08:00:50.305 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-06-21T08:00:50.307 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-06-21T08:00:50.330 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-06-21T08:00:50.364 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-21T08:00:50.383 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-21T08:00:50.401 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-21T08:00:50.405 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-21T08:00:50.406 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 5} 2023-06-21T08:00:50.425 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-21T08:00:50.426 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5} 2023-06-21T08:00:50.448 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.6 2023-06-21T08:00:50.448 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:00:50.451 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-21T08:00:50.451 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 5} 2023-06-21T08:00:50.473 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6 2023-06-21T08:00:50.474 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:00:50.496 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of rhel 8.6 2023-06-21T08:00:50.497 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:00:50.517 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T08:00:50.538 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T08:00:50.553 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1} 2023-06-21T08:00:50.557 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-06-21T08:00:50.569 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-06-21T08:00:50.590 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-06-21T08:00:50.609 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:00:50.617 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:00:50.637 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:00:50.723 INFO:teuthology.orchestra.console:Power off smithi029 2023-06-21T08:00:50.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T08:00:50.741 INFO:teuthology.orchestra.console:Power off smithi135 2023-06-21T08:00:50.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T08:00:50.758 INFO:teuthology.orchestra.console:Power off smithi032 2023-06-21T08:00:50.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T08:00:50.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:50.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:50.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:54.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:54.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:54.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:58.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:58.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:58.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:59.127 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2023-06-21T08:00:59.136 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-06-21T08:00:59.146 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-06-21T08:00:59.229 INFO:teuthology.orchestra.console:Power on smithi135 2023-06-21T08:00:59.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T08:00:59.238 INFO:teuthology.orchestra.console:Power on smithi029 2023-06-21T08:00:59.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T08:00:59.249 INFO:teuthology.orchestra.console:Power on smithi032 2023-06-21T08:00:59.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-21T08:00:59.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:59.270 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:00:59.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:03.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:03.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:03.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:07.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:07.417 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:07.424 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:01:07.619 INFO:teuthology.orchestra.console:Power on for smithi135 completed 2023-06-21T08:01:07.635 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2023-06-21T08:01:07.666 INFO:teuthology.orchestra.console:Power on for smithi029 completed 2023-06-21T08:01:07.721 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-06-21T08:01:07.721 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:01:07.736 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-06-21T08:01:07.737 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:01:07.767 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2023-06-21T08:01:07.768 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:01:22.816 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:01:22.817 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:01:22.835 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:01:37.920 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:01:37.921 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:01:37.922 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:01:53.024 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:01:53.025 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:01:53.026 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:02:08.124 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:02:08.126 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:02:08.127 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:02:23.224 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:02:23.225 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:02:23.226 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:02:38.317 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:02:38.319 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:02:38.320 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:02:53.420 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:02:53.422 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:02:53.423 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:03:08.508 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:03:08.509 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:03:08.510 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:03:23.600 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:03:23.601 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:03:23.603 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:03:38.688 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-06-21T08:03:38.690 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:03:38.691 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:03:38.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:03:41.840 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-21T08:03:47.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:03:50.900 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-21T08:03:53.756 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-06-21T08:03:53.758 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:03:53.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:03:56.884 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-06-21T08:03:56.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:03:59.952 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-21T08:04:02.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:05.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:05.968 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-06-21T08:04:08.820 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None 2023-06-21T08:04:08.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:09.012 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-06-21T08:04:11.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:15.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:15.024 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-06-21T08:04:21.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:24.080 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-06-21T08:04:30.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:33.140 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-06-21T08:04:39.006 ERROR:teuthology.orchestra.connection:Error authenticating with smithi029.front.sepia.ceph.com: Authentication timeout. 2023-06-21T08:04:39.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:42.192 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-06-21T08:04:48.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:04:58.352 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-06-21T08:05:04.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:05:15.016 WARNING:teuthology.provision.fog.smithi032:timed out 2023-06-21T08:05:21.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:05:21.349 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T08:05:21.350 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T08:05:21.682 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-06-21T08:05:21.682 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-06-21T08:05:21.702 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-06-21T08:05:21.703 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-06-21T08:05:21.761 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-06-21T08:05:21.762 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-06-21T08:05:21.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-06-21T08:05:21.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-06-21T08:05:21.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-06-21T08:05:22.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-06-21T08:05:22.129 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-06-21T08:05:22.188 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-06-21T08:05:22.188 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-06-21T08:05:22.189 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-21T08:05:22.190 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-06-21T08:05:22.190 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-21T08:05:22.190 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T08:05:22.190 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-21T08:05:22.191 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T08:05:22.191 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-21T08:05:22.191 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-21T08:05:22.191 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-21T08:05:22.192 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-06-21T08:05:22.193 DEBUG:teuthology.parallel:result is None 2023-06-21T08:05:48.197 WARNING:teuthology.provision.fog.smithi135:timed out 2023-06-21T08:05:54.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:05:54.510 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T08:05:54.510 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T08:05:54.793 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-06-21T08:05:54.793 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-06-21T08:05:54.811 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 2023-06-21T08:05:54.812 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135 /etc/hosts 2023-06-21T08:05:54.867 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-06-21T08:05:54.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-06-21T08:05:54.985 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135/smithi135/g' /etc/hosts 2023-06-21T08:05:55.014 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-06-21T08:05:55.080 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135/smithi135/g' /etc/hostname 2023-06-21T08:05:55.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-06-21T08:05:55.209 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-06-21T08:05:55.263 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-06-21T08:05:55.264 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-06-21T08:05:55.264 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-06-21T08:05:55.264 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-06-21T08:05:55.265 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-06-21T08:05:55.265 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-06-21T08:05:55.265 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-21T08:05:55.266 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-06-21T08:05:55.266 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-21T08:05:55.266 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-06-21T08:05:55.267 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-21T08:05:55.267 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T08:05:55.267 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-21T08:05:55.267 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T08:05:55.268 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-21T08:05:55.268 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-21T08:05:55.268 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-21T08:05:55.269 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-06-21T08:05:55.270 DEBUG:teuthology.parallel:result is None 2023-06-21T08:05:58.512 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-06-21T08:06:04.360 WARNING:teuthology.provision.fog.smithi029:timed out 2023-06-21T08:06:10.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:06:10.690 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-21T08:06:10.691 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-21T08:06:11.056 INFO:teuthology.provision.fog.smithi029:Node is ready 2023-06-21T08:06:11.057 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2023-06-21T08:06:11.076 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2023-06-21T08:06:11.076 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2023-06-21T08:06:11.134 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2023-06-21T08:06:11.135 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-06-21T08:06:11.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2023-06-21T08:06:11.311 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2023-06-21T08:06:11.381 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2023-06-21T08:06:11.451 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2023-06-21T08:06:11.520 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-06-21T08:06:11.577 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-06-21T08:06:11.577 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-06-21T08:06:11.577 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-06-21T08:06:11.578 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-06-21T08:06:11.578 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-06-21T08:06:11.578 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-06-21T08:06:11.578 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-21T08:06:11.578 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-06-21T08:06:11.578 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-21T08:06:11.579 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-21T08:06:11.580 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-21T08:06:11.580 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2023-06-21T08:06:11.581 DEBUG:teuthology.parallel:result is None 2023-06-21T08:06:11.800 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2023-06-21T08:06:11.802 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T08:06:11.825 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-06-21T08:06:11.826 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T08:06:11.850 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-06-21T08:06:11.851 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-21T08:06:11.876 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2023-06-21T08:06:11.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-06-21T08:06:11.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:06:11.944 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-06-21T08:06:12.010 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-06-21T08:06:12.066 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-06-21T08:06:12.067 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-06-21T08:06:12.123 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-06-21T08:06:12.123 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.6 (Ootpa)" 2023-06-21T08:06:12.124 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-06-21T08:06:12.124 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-06-21T08:06:12.124 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.6" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-21T08:06:12.125 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T08:06:12.126 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-06-21T08:06:12.126 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T08:06:12.126 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-21T08:06:12.126 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-21T08:06:12.126 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-21T08:06:12.127 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-06-21T08:06:12.150 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-06-21T08:06:12.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-06-21T08:06:12.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:06:12.216 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-06-21T08:06:12.310 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-06-21T08:06:12.368 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-06-21T08:06:12.368 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-06-21T08:06:12.426 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-06-21T08:06:12.426 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-06-21T08:06:12.426 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-06-21T08:06:12.426 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-06-21T08:06:12.426 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-06-21T08:06:12.427 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-06-21T08:06:12.427 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-21T08:06:12.427 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-06-21T08:06:12.427 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-21T08:06:12.427 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-06-21T08:06:12.427 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-21T08:06:12.428 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T08:06:12.428 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-06-21T08:06:12.428 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T08:06:12.428 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-21T08:06:12.428 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-21T08:06:12.428 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-21T08:06:12.429 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-06-21T08:06:12.450 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-06-21T08:06:12.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-06-21T08:06:12.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-21T08:06:12.517 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-06-21T08:06:12.650 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-06-21T08:06:12.708 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-06-21T08:06:12.708 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-06-21T08:06:12.766 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Red Hat Enterprise Linux" 2023-06-21T08:06:12.766 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8.6 (Ootpa)" 2023-06-21T08:06:12.766 INFO:teuthology.orchestra.run.smithi135.stdout:ID="rhel" 2023-06-21T08:06:12.766 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="fedora" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8.6" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.redhat.com/" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-21T08:06:12.767 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-21T08:06:12.768 INFO:teuthology.orchestra.run.smithi135.stdout: 2023-06-21T08:06:12.768 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-21T08:06:12.768 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-21T08:06:12.768 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-21T08:06:12.768 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-21T08:06:12.769 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-06-21T08:06:12.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:06:12.792 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:06:12.894 INFO:teuthology.dispatcher.supervisor:Running job 7309566 2023-06-21T08:06:12.895 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309566 --name vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309566/orig.config.yaml 2023-06-21T08:06:12.899 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309566 2023-06-21T08:06:12.899 INFO:teuthology.dispatcher.supervisor:Job PID: 20858 2023-06-21T08:06:12.900 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-21T08:08:13.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:08:13.001 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:10:13.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:10:13.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:12:13.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:12:13.354 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:14:13.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:14:13.526 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:16:13.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:16:13.684 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:18:13.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:18:13.858 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:20:14.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:20:14.033 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:22:14.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:22:14.206 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:24:14.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:24:14.383 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:26:14.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:26:14.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:28:14.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:28:14.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:30:14.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:30:14.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:32:15.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:32:15.112 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:34:15.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:34:15.285 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:36:15.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:36:15.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:38:15.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-21T08:38:15.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-21T08:38:15.697 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-21T08:38:15.939 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-21T08:38:15.940 INFO:teuthology.nuke:Checking targets against current locks 2023-06-21T08:38:15.988 DEBUG:teuthology.nuke:shortname: smithi029 2023-06-21T08:38:15.992 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T08:38:16.021 DEBUG:teuthology.nuke:shortname: smithi032 2023-06-21T08:38:16.022 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T08:38:16.027 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 08:00:49.172872', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-21T08:38:16.048 DEBUG:teuthology.nuke:shortname: smithi135 2023-06-21T08:38:16.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-21T08:38:16.053 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 08:00:49.170842', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-21T08:38:16.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-21_05:44:47-fs-wip-vshankar-testing-20230620.131636-testing-default-smithi/7309566', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 08:00:49.168468', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-21T08:38:16.086 INFO:teuthology.orchestra.console:Power off smithi029 2023-06-21T08:38:16.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T08:38:16.106 INFO:teuthology.orchestra.console:Power off smithi032 2023-06-21T08:38:16.107 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T08:38:16.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:38:16.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:38:16.146 INFO:teuthology.orchestra.console:Power off smithi135 2023-06-21T08:38:16.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-21T08:38:16.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-21T08:38:16.256 INFO:teuthology.orchestra.console:Power off for smithi029 completed 2023-06-21T08:38:16.257 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-06-21T08:38:16.293 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2023-06-21T08:38:16.421 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com 2023-06-21T08:38:16.438 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-06-21T08:38:16.447 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com