2023-06-22T13:29:40.209 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T13:29:40.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:29:40.211 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:29:40.411 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe690546670>, signals=[15]) 2023-06-22T13:29:40.413 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2023-06-22T13:29:40.413 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:29:40.414 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-06-22T13:29:40.431 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-06-22T13:29:40.431 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:29:40.431 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-06-22T13:29:40.433 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"} 2023-06-22T13:29:40.455 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2023-06-22T13:29:40.456 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T13:29:40.456 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-06-22T13:29:40.457 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-06-22T13:29:40.480 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /host {"name": "smithi145"} 2023-06-22T13:29:40.512 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T13:29:40.527 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T13:29:40.545 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-22T13:29:40.551 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T13:29:40.551 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 5} 2023-06-22T13:29:40.568 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T13:29:40.569 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 5} 2023-06-22T13:29:40.584 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-22T13:29:40.584 DEBUG:teuthology.provision.fog.smithi145:FOG request: PUT /host/250 {"imageID": 5} 2023-06-22T13:29:40.593 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of rhel 8.6 2023-06-22T13:29:40.594 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:29:40.620 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.6 2023-06-22T13:29:40.620 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:29:40.636 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of rhel 8.6 2023-06-22T13:29:40.637 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:29:40.663 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:29:40.685 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:29:40.698 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T13:29:40.705 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1} 2023-06-22T13:29:40.717 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-06-22T13:29:40.743 DEBUG:teuthology.provision.fog.smithi145:FOG request: POST /host/250/task {"taskTypeID": 1} 2023-06-22T13:29:40.769 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:29:40.772 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:29:40.804 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:29:40.877 INFO:teuthology.orchestra.console:Power off smithi019 2023-06-22T13:29:40.878 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:29:40.892 INFO:teuthology.orchestra.console:Power off smithi073 2023-06-22T13:29:40.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:29:40.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:40.917 INFO:teuthology.orchestra.console:Power off smithi145 2023-06-22T13:29:40.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T13:29:40.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:40.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:41.027 INFO:teuthology.orchestra.console:Power off for smithi019 completed 2023-06-22T13:29:41.048 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-06-22T13:29:41.058 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-06-22T13:29:41.128 INFO:teuthology.orchestra.console:Power on smithi019 2023-06-22T13:29:41.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:29:41.149 INFO:teuthology.orchestra.console:Power on smithi073 2023-06-22T13:29:41.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:29:41.159 INFO:teuthology.orchestra.console:Power on smithi145 2023-06-22T13:29:41.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T13:29:41.170 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:41.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:41.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:45.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:45.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:45.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:49.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:49.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:49.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T13:29:49.533 INFO:teuthology.orchestra.console:Power on for smithi019 completed 2023-06-22T13:29:49.573 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2023-06-22T13:29:49.590 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2023-06-22T13:29:49.634 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2023-06-22T13:29:49.634 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:29:49.674 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-06-22T13:29:49.674 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:29:49.691 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2023-06-22T13:29:49.691 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:30:04.713 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:30:04.742 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:30:04.756 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:30:19.796 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:30:19.820 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:30:19.822 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:30:34.872 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:30:34.889 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:30:34.899 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:30:49.948 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:30:49.951 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:30:49.971 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:31:05.028 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:31:05.029 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:31:05.037 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:31:20.104 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:31:20.105 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:31:20.110 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:31:35.176 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:31:35.178 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:31:35.179 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:31:50.284 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:31:50.286 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:31:50.287 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:32:05.384 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:32:05.415 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:32:05.416 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:32:20.511 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:32:20.513 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:32:20.513 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:32:35.600 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:32:35.601 DEBUG:teuthology.provision.fog.smithi145:FOG request: GET /task/active None 2023-06-22T13:32:35.602 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-06-22T13:32:35.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:32:35.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:32:38.740 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-22T13:32:44.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:32:47.828 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-22T13:32:50.673 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:32:53.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:32:54.000 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-06-22T13:32:56.914 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-22T13:33:00.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:02.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:03.056 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-06-22T13:33:05.740 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:33:05.968 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-22T13:33:09.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:11.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:12.112 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-06-22T13:33:15.024 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-22T13:33:18.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:20.806 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:33:21.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:21.168 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2023-06-22T13:33:24.080 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-06-22T13:33:27.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:30.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:33:35.876 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:33:50.964 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:34:06.044 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-06-22T13:34:06.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:09.168 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-06-22T13:34:15.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:18.256 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-06-22T13:34:24.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:27.177 WARNING:teuthology.provision.fog.smithi145:timed out 2023-06-22T13:34:27.344 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-06-22T13:34:30.088 WARNING:teuthology.provision.fog.smithi073:timed out 2023-06-22T13:34:33.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:33.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:33.520 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:34:33.521 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:34:33.802 INFO:teuthology.provision.fog.smithi145:Node is ready 2023-06-22T13:34:33.803 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2023-06-22T13:34:33.820 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145 2023-06-22T13:34:33.821 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145 /etc/hosts 2023-06-22T13:34:33.879 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2023-06-22T13:34:33.879 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-06-22T13:34:34.000 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hosts 2023-06-22T13:34:34.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2023-06-22T13:34:34.095 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145/smithi145/g' /etc/hostname 2023-06-22T13:34:34.162 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2023-06-22T13:34:34.228 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-06-22T13:34:34.284 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:34:34.285 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:34:34.286 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:34:34.287 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:34:34.287 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2023-06-22T13:34:34.289 DEBUG:teuthology.parallel:result is None 2023-06-22T13:34:36.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:36.400 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-06-22T13:34:36.425 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:34:36.426 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:34:36.729 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-06-22T13:34:36.729 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-06-22T13:34:36.746 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073 2023-06-22T13:34:36.747 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073 /etc/hosts 2023-06-22T13:34:36.804 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-06-22T13:34:36.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-06-22T13:34:36.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hosts 2023-06-22T13:34:36.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-06-22T13:34:37.025 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hostname 2023-06-22T13:34:37.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-06-22T13:34:37.164 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-06-22T13:34:37.223 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:34:37.223 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-06-22T13:34:37.224 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:34:37.225 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:34:37.226 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-06-22T13:34:37.226 DEBUG:teuthology.parallel:result is None 2023-06-22T13:34:42.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:45.488 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-06-22T13:34:51.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:34:54.544 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-06-22T13:35:00.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:36:00.612 WARNING:teuthology.provision.fog.smithi019:timed out 2023-06-22T13:36:06.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:36:06.943 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T13:36:06.944 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T13:36:07.267 INFO:teuthology.provision.fog.smithi019:Node is ready 2023-06-22T13:36:07.329 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2023-06-22T13:36:07.350 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2023-06-22T13:36:07.351 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2023-06-22T13:36:07.411 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2023-06-22T13:36:07.412 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-06-22T13:36:07.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2023-06-22T13:36:07.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2023-06-22T13:36:07.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2023-06-22T13:36:07.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-06-22T13:36:07.795 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-06-22T13:36:07.857 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:36:07.858 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:36:07.858 INFO:teuthology.orchestra.run.smithi019.stdout:ID="rhel" 2023-06-22T13:36:07.858 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="fedora" 2023-06-22T13:36:07.859 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8.6" 2023-06-22T13:36:07.859 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:36:07.859 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:36:07.860 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-06-22T13:36:07.860 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:36:07.860 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:36:07.860 INFO:teuthology.orchestra.run.smithi019.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:36:07.861 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:36:07.861 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-06-22T13:36:07.861 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:36:07.861 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:36:07.862 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:36:07.862 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:36:07.862 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2023-06-22T13:36:07.863 DEBUG:teuthology.parallel:result is None 2023-06-22T13:36:08.124 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2023-06-22T13:36:08.125 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:36:08.150 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2023-06-22T13:36:08.151 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:36:08.174 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2023-06-22T13:36:08.175 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T13:36:08.202 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:36:08.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-06-22T13:36:08.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:36:08.272 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-06-22T13:36:08.343 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-06-22T13:36:08.403 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-06-22T13:36:08.404 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-06-22T13:36:08.465 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:36:08.465 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:36:08.465 INFO:teuthology.orchestra.run.smithi019.stdout:ID="rhel" 2023-06-22T13:36:08.466 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="fedora" 2023-06-22T13:36:08.466 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8.6" 2023-06-22T13:36:08.466 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:36:08.466 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:36:08.467 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-06-22T13:36:08.467 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:36:08.467 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:36:08.467 INFO:teuthology.orchestra.run.smithi019.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:36:08.467 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:36:08.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-06-22T13:36:08.468 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:36:08.468 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:36:08.468 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:36:08.468 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:36:08.469 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-06-22T13:36:08.491 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:36:08.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-06-22T13:36:08.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:36:08.564 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-06-22T13:36:08.702 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-06-22T13:36:08.764 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-06-22T13:36:08.764 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-06-22T13:36:08.823 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:36:08.824 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:36:08.825 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:36:08.826 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:36:08.826 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:36:08.826 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-06-22T13:36:08.850 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2023-06-22T13:36:08.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2023-06-22T13:36:08.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T13:36:08.920 DEBUG:teuthology.orchestra.run.smithi145:> true 2023-06-22T13:36:09.054 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2023-06-22T13:36:09.114 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2023-06-22T13:36:09.114 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2023-06-22T13:36:09.173 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Red Hat Enterprise Linux" 2023-06-22T13:36:09.174 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="8.6 (Ootpa)" 2023-06-22T13:36:09.174 INFO:teuthology.orchestra.run.smithi145.stdout:ID="rhel" 2023-06-22T13:36:09.174 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="fedora" 2023-06-22T13:36:09.174 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="8.6" 2023-06-22T13:36:09.174 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el8" 2023-06-22T13:36:09.174 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.redhat.com/" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout: 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T13:36:09.175 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-22T13:36:09.176 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-22T13:36:09.176 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-22T13:36:09.176 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2023-06-22T13:36:09.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:36:09.200 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:36:09.313 INFO:teuthology.dispatcher.supervisor:Running job 7311437 2023-06-22T13:36:09.314 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311437 --name rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/iogen}} -- /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311437/orig.config.yaml 2023-06-22T13:36:09.317 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311437 2023-06-22T13:36:09.318 INFO:teuthology.dispatcher.supervisor:Job PID: 6403 2023-06-22T13:36:09.318 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-22T13:38:09.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:38:09.420 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:40:09.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:40:09.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:42:09.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:42:09.770 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:44:09.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:44:09.944 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:46:10.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:46:10.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:48:10.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:48:10.290 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:50:10.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:50:10.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:52:10.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:52:10.634 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:54:10.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:54:10.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:56:10.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:56:10.963 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T13:58:11.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T13:58:11.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:00:11.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T14:00:11.310 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T14:00:11.387 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-22T14:00:11.629 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-22T14:00:11.629 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T14:00:11.683 DEBUG:teuthology.nuke:shortname: smithi019 2023-06-22T14:00:11.684 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:00:11.701 DEBUG:teuthology.nuke:shortname: smithi073 2023-06-22T14:00:11.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:00:11.704 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:29:39.328223', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-22T14:00:11.726 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:29:39.326926', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T14:00:11.731 DEBUG:teuthology.nuke:shortname: smithi145 2023-06-22T14:00:11.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T14:00:11.760 INFO:teuthology.orchestra.console:Power off smithi019 2023-06-22T14:00:11.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:00:11.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-22_11:20:21-fs-wip-rishabh-CephManager-in-CephFSTestCase-testing-default-smithi/7311437', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 13:29:39.325441', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-06-22T14:00:11.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:00:11.801 INFO:teuthology.orchestra.console:Power off smithi073 2023-06-22T14:00:11.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:00:11.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:00:11.845 INFO:teuthology.orchestra.console:Power off smithi145 2023-06-22T14:00:11.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T14:00:11.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T14:00:11.916 INFO:teuthology.orchestra.console:Power off for smithi019 completed 2023-06-22T14:00:11.955 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-06-22T14:00:11.988 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2023-06-22T14:00:12.077 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com 2023-06-22T14:00:12.110 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-06-22T14:00:12.135 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com