2023-07-19T17:06:14.938 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T17:06:14.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:06:14.940 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:06:15.134 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c4e75c8b0>, signals=[15]) 2023-07-19T17:06:15.136 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-07-19T17:06:15.136 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T17:06:15.137 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-19T17:06:15.164 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-07-19T17:06:15.164 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T17:06:15.165 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-19T17:06:15.166 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-07-19T17:06:15.188 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-07-19T17:06:15.189 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T17:06:15.189 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-07-19T17:06:15.190 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-07-19T17:06:15.216 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-07-19T17:06:15.241 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T17:06:15.263 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T17:06:15.277 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T17:06:15.278 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 5} 2023-07-19T17:06:15.287 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-19T17:06:15.302 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T17:06:15.302 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 5} 2023-07-19T17:06:15.314 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of rhel 8.6 2023-07-19T17:06:15.314 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:06:15.325 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-19T17:06:15.326 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 5} 2023-07-19T17:06:15.353 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T17:06:15.356 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of rhel 8.6 2023-07-19T17:06:15.356 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:06:15.376 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of rhel 8.6 2023-07-19T17:06:15.377 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:06:15.394 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-07-19T17:06:15.401 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T17:06:15.429 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T17:06:15.434 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-07-19T17:06:15.454 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:06:15.469 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-07-19T17:06:15.489 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:06:15.522 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:06:15.545 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-19T17:06:15.546 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:06:15.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:15.589 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-19T17:06:15.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:06:15.607 INFO:teuthology.orchestra.console:Power off smithi061 2023-07-19T17:06:15.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:06:15.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:15.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:15.719 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-19T17:06:15.746 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-19T17:06:15.755 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-07-19T17:06:15.821 INFO:teuthology.orchestra.console:Power on smithi040 2023-07-19T17:06:15.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T17:06:15.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:15.854 INFO:teuthology.orchestra.console:Power on smithi055 2023-07-19T17:06:15.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T17:06:15.863 INFO:teuthology.orchestra.console:Power on smithi061 2023-07-19T17:06:15.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T17:06:15.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:15.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:19.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:19.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:19.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:20.115 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2023-07-19T17:06:20.216 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-07-19T17:06:20.217 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:06:23.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:24.026 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:06:24.209 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2023-07-19T17:06:24.310 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-07-19T17:06:24.311 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:06:24.355 INFO:teuthology.orchestra.console:Power on for smithi061 completed 2023-07-19T17:06:24.456 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-07-19T17:06:24.457 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:06:35.283 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:06:39.368 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:06:39.509 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:06:50.388 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:06:54.424 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:06:54.560 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:07:05.453 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:07:09.480 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:07:09.611 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:07:20.516 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:07:24.543 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:07:24.659 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:07:35.580 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:07:39.603 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:07:39.713 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:07:50.644 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:07:54.668 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:07:54.767 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:08:05.724 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:08:09.744 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:08:09.833 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:08:20.800 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:08:24.820 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:08:24.900 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:08:35.880 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:08:39.896 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:08:39.962 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:08:50.949 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-07-19T17:08:51.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:08:54.064 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-19T17:08:54.976 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-19T17:08:55.026 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:08:55.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:08:58.096 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-19T17:09:00.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:03.124 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-19T17:09:04.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:07.152 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-19T17:09:09.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:10.082 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-07-19T17:09:10.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:12.208 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-19T17:09:13.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:13.200 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:09:16.212 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-19T17:09:18.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:19.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:21.264 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-19T17:09:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:22.260 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:09:25.264 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-19T17:09:27.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:28.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:30.324 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-07-19T17:09:31.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:31.344 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:09:34.320 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-19T17:09:36.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:37.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:40.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:40.404 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:09:43.380 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-19T17:09:46.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:49.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:49.488 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:09:55.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:09:58.544 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:10:04.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:10:07.600 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-07-19T17:10:13.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:10:36.348 WARNING:teuthology.provision.fog.smithi055:timed out 2023-07-19T17:10:42.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:10:42.685 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T17:10:42.686 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T17:10:42.987 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-07-19T17:10:42.987 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-07-19T17:10:43.006 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2023-07-19T17:10:43.007 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2023-07-19T17:10:43.065 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2023-07-19T17:10:43.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-07-19T17:10:43.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2023-07-19T17:10:43.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2023-07-19T17:10:43.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2023-07-19T17:10:43.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-07-19T17:10:43.427 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-19T17:10:43.485 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:10:43.485 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:10:43.485 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:10:43.486 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:10:43.487 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:10:43.487 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:10:43.487 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-19T17:10:43.487 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:10:43.487 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:10:43.488 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:10:43.488 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:10:43.488 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-07-19T17:10:43.490 DEBUG:teuthology.parallel:result is None 2023-07-19T17:10:49.392 WARNING:teuthology.provision.fog.smithi040:timed out 2023-07-19T17:10:55.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:10:55.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T17:10:55.613 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T17:10:55.943 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-07-19T17:10:55.943 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-07-19T17:10:55.962 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-07-19T17:10:55.962 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-07-19T17:10:56.021 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-07-19T17:10:56.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-19T17:10:56.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-07-19T17:10:56.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-07-19T17:10:56.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-07-19T17:10:56.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-19T17:10:56.368 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-19T17:10:56.426 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:10:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:10:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2023-07-19T17:10:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2023-07-19T17:10:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.6" 2023-07-19T17:10:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:10:56.427 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:10:56.428 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-19T17:10:56.428 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:10:56.428 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:10:56.428 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:10:56.429 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:10:56.429 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-19T17:10:56.430 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:10:56.430 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:10:56.430 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:10:56.430 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:10:56.431 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-07-19T17:10:56.431 DEBUG:teuthology.parallel:result is None 2023-07-19T17:11:13.622 WARNING:teuthology.provision.fog.smithi061:timed out 2023-07-19T17:11:19.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:11:19.955 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T17:11:19.956 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T17:11:20.298 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-07-19T17:11:20.298 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-07-19T17:11:20.318 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-07-19T17:11:20.318 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-07-19T17:11:20.376 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-07-19T17:11:20.377 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-07-19T17:11:20.488 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-07-19T17:11:20.518 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-07-19T17:11:20.588 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-07-19T17:11:20.656 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-07-19T17:11:20.722 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-07-19T17:11:20.779 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:11:20.779 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-07-19T17:11:20.780 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:11:20.781 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:11:20.782 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:11:20.782 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-07-19T17:11:20.782 DEBUG:teuthology.parallel:result is None 2023-07-19T17:11:21.016 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-07-19T17:11:21.017 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-19T17:11:21.046 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-07-19T17:11:21.047 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-07-19T17:11:21.048 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-07-19T17:11:21.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-19T17:11:21.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:11:21.118 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-19T17:11:21.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-19T17:11:21.255 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-07-19T17:11:21.313 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-07-19T17:11:21.314 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-19T17:11:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:11:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:11:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2023-07-19T17:11:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2023-07-19T17:11:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.6" 2023-07-19T17:11:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:11:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:11:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-19T17:11:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:11:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:11:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:11:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:11:21.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-19T17:11:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:11:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:11:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:11:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:11:21.377 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-19T17:11:21.405 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-07-19T17:11:21.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-19T17:11:21.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:11:21.473 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-07-19T17:11:21.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-07-19T17:11:21.607 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-07-19T17:11:21.665 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-07-19T17:11:21.666 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-07-19T17:11:21.724 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:11:21.724 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:11:21.724 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:11:21.725 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:11:21.726 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:11:21.727 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-07-19T17:11:21.746 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-07-19T17:11:21.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-07-19T17:11:21.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T17:11:21.813 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-07-19T17:11:21.884 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-07-19T17:11:21.885 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-07-19T17:11:21.944 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-07-19T17:11:21.944 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-07-19T17:11:22.004 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Red Hat Enterprise Linux" 2023-07-19T17:11:22.005 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8.6 (Ootpa)" 2023-07-19T17:11:22.005 INFO:teuthology.orchestra.run.smithi061.stdout:ID="rhel" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="fedora" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8.6" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.redhat.com/" 2023-07-19T17:11:22.006 INFO:teuthology.orchestra.run.smithi061.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-19T17:11:22.007 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-19T17:11:22.007 INFO:teuthology.orchestra.run.smithi061.stdout: 2023-07-19T17:11:22.007 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-19T17:11:22.007 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-19T17:11:22.007 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-19T17:11:22.007 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-19T17:11:22.008 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-07-19T17:11:22.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:11:22.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:11:22.148 INFO:teuthology.dispatcher.supervisor:Running job 7344144 2023-07-19T17:11:22.148 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344144 --name pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344144/orig.config.yaml 2023-07-19T17:11:22.152 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344144 2023-07-19T17:11:22.153 INFO:teuthology.dispatcher.supervisor:Job PID: 23179 2023-07-19T17:11:22.153 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-19T17:13:22.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:13:22.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:15:22.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:15:22.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:17:22.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:17:22.616 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:19:22.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:19:22.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:21:22.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:21:22.965 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:23:23.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:23:23.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:25:23.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:25:23.235 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:27:23.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:27:23.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:29:23.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:29:23.602 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:31:23.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:31:23.774 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:33:23.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:33:23.949 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:35:24.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:35:24.133 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:37:24.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:37:24.306 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:39:24.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:39:24.481 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:41:24.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:41:24.653 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:43:24.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T17:43:24.837 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T17:43:24.907 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-19T17:43:25.066 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-19T17:43:25.067 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T17:43:25.120 DEBUG:teuthology.nuke:shortname: smithi040 2023-07-19T17:43:25.121 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T17:43:25.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:06:14.076913', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T17:43:25.155 DEBUG:teuthology.nuke:shortname: smithi055 2023-07-19T17:43:25.155 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T17:43:25.170 DEBUG:teuthology.nuke:shortname: smithi061 2023-07-19T17:43:25.170 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T17:43:25.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:06:14.079528', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T17:43:25.200 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-19T17:43:25.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:43:25.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344144', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:06:14.078353', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-19T17:43:25.226 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:43:25.247 INFO:teuthology.orchestra.console:Power off smithi055 2023-07-19T17:43:25.247 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:43:25.269 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:43:25.293 INFO:teuthology.orchestra.console:Power off smithi061 2023-07-19T17:43:25.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T17:43:25.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T17:43:25.362 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-19T17:43:25.406 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2023-07-19T17:43:25.442 INFO:teuthology.orchestra.console:Power off for smithi061 completed 2023-07-19T17:43:25.514 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-07-19T17:43:25.547 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2023-07-19T17:43:25.590 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com