2023-07-14T18:17:05.964 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T18:17:05.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:17:05.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:17:06.186 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59f20d98b0>, signals=[15]) 2023-07-14T18:17:06.188 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-07-14T18:17:06.188 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T18:17:06.188 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-14T18:17:06.214 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-07-14T18:17:06.215 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T18:17:06.215 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-07-14T18:17:06.216 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-07-14T18:17:06.239 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-07-14T18:17:06.239 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T18:17:06.239 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-07-14T18:17:06.240 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-07-14T18:17:06.255 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-07-14T18:17:06.291 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T18:17:06.310 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T18:17:06.320 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T18:17:06.335 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T18:17:06.335 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 5} 2023-07-14T18:17:06.350 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T18:17:06.350 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 5} 2023-07-14T18:17:06.357 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T18:17:06.357 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 5} 2023-07-14T18:17:06.381 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-07-14T18:17:06.381 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:17:06.404 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-07-14T18:17:06.404 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:17:06.409 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.6 2023-07-14T18:17:06.409 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:17:06.444 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T18:17:06.464 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T18:17:06.472 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T18:17:06.480 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-07-14T18:17:06.509 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-07-14T18:17:06.512 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-07-14T18:17:06.530 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:17:06.609 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:17:06.627 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:17:06.675 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-14T18:17:06.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:17:06.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:06.724 INFO:teuthology.orchestra.console:Power off smithi190 2023-07-14T18:17:06.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:17:06.740 INFO:teuthology.orchestra.console:Power off smithi194 2023-07-14T18:17:06.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:17:06.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:06.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:10.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:10.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:10.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:15.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:15.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:15.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:16.103 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2023-07-14T18:17:16.205 INFO:teuthology.orchestra.console:Power on smithi194 2023-07-14T18:17:16.205 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T18:17:16.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:20.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:20.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:20.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:25.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:26.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:26.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:30.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:30.688 INFO:teuthology.orchestra.console:Power on for smithi194 completed 2023-07-14T18:17:30.789 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-07-14T18:17:30.790 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:17:31.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:31.217 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:31.429 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-07-14T18:17:31.530 INFO:teuthology.orchestra.console:Power on smithi190 2023-07-14T18:17:31.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T18:17:31.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:35.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:36.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:36.491 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-14T18:17:36.592 INFO:teuthology.orchestra.console:Power on smithi083 2023-07-14T18:17:36.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T18:17:36.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:40.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:40.683 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:45.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:45.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:45.860 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:17:46.004 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2023-07-14T18:17:46.105 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-07-14T18:17:46.105 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:17:50.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:55.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:17:56.184 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-07-14T18:17:56.285 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-07-14T18:17:56.286 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:18:00.936 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:18:01.172 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:18:11.372 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:18:20.518 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:18:20.519 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:18:35.700 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:18:35.701 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:18:50.639 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:19:10.660 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:19:10.733 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:19:10.735 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:19:25.744 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:19:30.748 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:19:30.749 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:19:55.848 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:19:55.850 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:19:55.851 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:20:20.972 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-14T18:20:20.974 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:20:20.975 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:20:21.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:20:24.112 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-14T18:20:30.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:20:36.068 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:20:36.069 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-07-14T18:20:46.080 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-14T18:20:46.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:20:52.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:20:57.085 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-14T18:21:00.144 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-14T18:21:03.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:08.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:13.097 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-07-14T18:21:18.101 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-14T18:21:18.101 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-14T18:21:18.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:24.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:24.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:26.224 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-14T18:21:32.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:40.304 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-07-14T18:21:42.640 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-14T18:21:42.641 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-07-14T18:21:46.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:51.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:21:56.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:22:01.321 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-14T18:22:01.850 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T18:22:01.852 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T18:22:02.152 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-07-14T18:22:02.153 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-07-14T18:22:02.169 INFO:teuthology.orchestra.run.smithi190.stdout:smithi022 2023-07-14T18:22:02.169 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi022 /etc/hosts 2023-07-14T18:22:02.224 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-07-14T18:22:02.225 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-07-14T18:22:02.331 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi022/smithi190/g' /etc/hosts 2023-07-14T18:22:02.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.22/172.21.15.190/g' /etc/hosts 2023-07-14T18:22:02.424 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi022/smithi190/g' /etc/hostname 2023-07-14T18:22:02.490 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-07-14T18:22:02.556 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-07-14T18:22:02.612 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T18:22:02.612 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T18:22:02.612 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-07-14T18:22:02.612 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-07-14T18:22:02.613 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-07-14T18:22:02.613 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-07-14T18:22:02.614 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T18:22:02.614 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-07-14T18:22:02.614 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T18:22:02.614 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T18:22:02.614 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T18:22:02.614 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T18:22:02.615 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-07-14T18:22:02.615 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T18:22:02.615 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T18:22:02.615 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T18:22:02.615 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T18:22:02.616 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-07-14T18:22:02.617 DEBUG:teuthology.parallel:result is None 2023-07-14T18:22:07.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:22:12.652 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T18:22:12.652 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T18:22:12.907 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-07-14T18:22:12.908 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-07-14T18:22:12.924 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2023-07-14T18:22:12.925 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2023-07-14T18:22:12.981 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-07-14T18:22:12.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-07-14T18:22:13.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2023-07-14T18:22:13.134 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-07-14T18:22:13.201 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2023-07-14T18:22:13.267 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-07-14T18:22:13.333 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-07-14T18:22:13.389 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T18:22:13.389 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-07-14T18:22:13.390 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T18:22:13.391 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T18:22:13.392 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-07-14T18:22:13.392 DEBUG:teuthology.parallel:result is None 2023-07-14T18:22:51.348 WARNING:teuthology.provision.fog.smithi083:timed out 2023-07-14T18:22:57.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:23:02.939 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T18:23:02.940 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T18:23:03.252 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-07-14T18:23:03.252 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-07-14T18:23:03.270 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083 2023-07-14T18:23:03.271 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083 /etc/hosts 2023-07-14T18:23:03.329 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-07-14T18:23:03.329 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-14T18:23:03.462 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083/smithi083/g' /etc/hosts 2023-07-14T18:23:03.491 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-07-14T18:23:03.559 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083/smithi083/g' /etc/hostname 2023-07-14T18:23:03.627 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-07-14T18:23:03.693 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-14T18:23:03.751 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T18:23:03.751 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T18:23:03.751 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T18:23:03.752 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T18:23:03.753 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T18:23:03.754 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-07-14T18:23:03.754 DEBUG:teuthology.parallel:result is None 2023-07-14T18:23:06.192 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-07-14T18:23:06.193 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-07-14T18:23:06.193 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-07-14T18:23:06.195 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-07-14T18:23:06.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-14T18:23:06.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:23:06.303 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-07-14T18:23:06.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-07-14T18:23:06.374 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-07-14T18:23:06.433 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-07-14T18:23:06.434 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-07-14T18:23:06.491 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T18:23:06.492 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T18:23:06.492 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-07-14T18:23:06.492 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-07-14T18:23:06.492 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-07-14T18:23:06.492 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-07-14T18:23:06.492 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T18:23:06.493 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T18:23:06.494 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T18:23:06.494 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T18:23:06.494 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-07-14T18:23:11.530 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-07-14T18:23:11.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-07-14T18:23:11.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:23:11.597 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-07-14T18:23:11.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-07-14T18:23:11.731 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-07-14T18:23:11.788 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-07-14T18:23:11.789 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-07-14T18:23:11.845 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T18:23:11.846 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T18:23:11.846 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-07-14T18:23:11.846 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-07-14T18:23:11.846 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-07-14T18:23:11.846 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-07-14T18:23:11.846 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T18:23:11.847 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-07-14T18:23:11.847 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T18:23:11.847 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T18:23:11.847 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T18:23:11.847 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T18:23:11.848 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-07-14T18:23:11.848 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T18:23:11.848 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T18:23:11.849 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T18:23:11.849 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T18:23:11.850 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-07-14T18:23:11.880 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-07-14T18:23:11.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-14T18:23:11.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T18:23:11.947 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-07-14T18:23:12.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-14T18:23:12.082 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-07-14T18:23:12.141 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-07-14T18:23:12.141 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-07-14T18:23:12.199 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T18:23:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T18:23:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-07-14T18:23:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-07-14T18:23:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-07-14T18:23:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-07-14T18:23:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T18:23:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T18:23:12.202 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T18:23:12.202 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T18:23:12.202 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-07-14T18:23:12.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:23:12.231 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:23:12.347 INFO:teuthology.dispatcher.supervisor:Running job 7338029 2023-07-14T18:23:12.347 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7338029 --name pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7338029/orig.config.yaml 2023-07-14T18:23:12.352 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7338029 2023-07-14T18:23:12.353 INFO:teuthology.dispatcher.supervisor:Job PID: 12644 2023-07-14T18:23:12.353 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-14T18:25:12.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:25:12.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:27:17.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:27:17.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:29:22.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:29:22.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:31:27.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:31:27.972 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:33:31.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:33:31.779 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:35:36.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:35:36.969 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:37:41.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:37:41.917 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:39:47.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:39:47.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:41:47.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:41:47.300 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:43:52.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:43:52.469 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:45:57.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:45:57.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:48:02.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:48:02.467 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:50:02.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:50:02.649 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:52:07.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:52:07.819 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:54:12.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:54:12.691 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:56:16.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T18:56:16.190 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T18:56:20.256 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-14T18:56:25.287 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-14T18:56:25.288 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T18:56:25.342 DEBUG:teuthology.nuke:shortname: smithi083 2023-07-14T18:56:25.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T18:56:25.367 DEBUG:teuthology.nuke:shortname: smithi190 2023-07-14T18:56:25.367 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T18:56:25.370 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7338029', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 18:16:55.070260', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T18:56:25.389 DEBUG:teuthology.nuke:shortname: smithi194 2023-07-14T18:56:25.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T18:56:25.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7338029', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 18:16:55.073609', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T18:56:25.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7338029', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 18:16:55.072335', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T18:56:25.427 INFO:teuthology.orchestra.console:Power off smithi083 2023-07-14T18:56:25.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:56:25.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:56:25.473 INFO:teuthology.orchestra.console:Power off smithi194 2023-07-14T18:56:25.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:56:25.488 INFO:teuthology.orchestra.console:Power off smithi190 2023-07-14T18:56:25.489 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T18:56:25.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:56:25.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T18:56:25.609 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-07-14T18:56:25.624 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2023-07-14T18:56:25.636 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2023-07-14T18:56:25.777 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-07-14T18:56:25.785 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com 2023-07-14T18:56:25.793 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com