2023-07-19T17:22:14.837 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-19T17:22:14.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:22:14.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:22:15.043 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb6807135e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb6819318b0>, signals=[15])
2023-07-19T17:22:15.045 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-07-19T17:22:15.045 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-07-19T17:22:15.045 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-07-19T17:22:15.064 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2023-07-19T17:22:15.065 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2023-07-19T17:22:15.065 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-07-19T17:22:15.068 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-07-19T17:22:15.098 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging
2023-07-19T17:22:15.098 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server
2023-07-19T17:22:15.099 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2023-07-19T17:22:15.101 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"}
2023-07-19T17:22:15.121 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"}
2023-07-19T17:22:15.145 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-19T17:22:15.178 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-19T17:22:15.183 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-19T17:22:15.184 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 5}
2023-07-19T17:22:15.214 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-19T17:22:15.214 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 5}
2023-07-19T17:22:15.218 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-19T17:22:15.230 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6
2023-07-19T17:22:15.231 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:22:15.250 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-19T17:22:15.251 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 5}
2023-07-19T17:22:15.258 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6
2023-07-19T17:22:15.258 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:22:15.273 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-07-19T17:22:15.295 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.6
2023-07-19T17:22:15.296 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:22:15.305 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"}
2023-07-19T17:22:15.309 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-07-19T17:22:15.335 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1}
2023-07-19T17:22:15.348 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"}
2023-07-19T17:22:15.371 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:22:15.385 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:22:15.389 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1}
2023-07-19T17:22:15.439 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:22:15.458 INFO:teuthology.orchestra.console:Power off smithi105
2023-07-19T17:22:15.459 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:22:15.475 INFO:teuthology.orchestra.console:Power off smithi132
2023-07-19T17:22:15.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:22:15.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:15.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:15.532 INFO:teuthology.orchestra.console:Power off smithi143
2023-07-19T17:22:15.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:22:15.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:15.610 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-07-19T17:22:15.622 INFO:teuthology.orchestra.console:Power off for smithi132 completed
2023-07-19T17:22:15.678 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2023-07-19T17:22:15.712 INFO:teuthology.orchestra.console:Power on smithi105
2023-07-19T17:22:15.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-19T17:22:15.723 INFO:teuthology.orchestra.console:Power on smithi132
2023-07-19T17:22:15.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-19T17:22:15.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:15.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:15.780 INFO:teuthology.orchestra.console:Power on smithi143
2023-07-19T17:22:15.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-19T17:22:15.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:19.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:19.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:19.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:19.986 INFO:teuthology.orchestra.console:Power on for smithi132 completed
2023-07-19T17:22:20.037 INFO:teuthology.orchestra.console:Power on for smithi143 completed
2023-07-19T17:22:20.087 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2023-07-19T17:22:20.088 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:22:20.138 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2023-07-19T17:22:20.138 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:22:23.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:22:24.087 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2023-07-19T17:22:24.188 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-07-19T17:22:24.189 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:22:35.152 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:22:35.185 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:22:39.244 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:22:50.224 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:22:50.231 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:22:54.300 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:23:05.288 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:23:05.289 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:23:09.356 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:23:20.356 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:23:20.357 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:23:24.423 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:23:35.438 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:23:35.440 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:23:39.488 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:23:50.532 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:23:50.533 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:23:54.553 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:24:05.604 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:24:05.606 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:24:09.623 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:24:20.676 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:24:20.678 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:24:24.696 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:24:35.745 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:24:35.747 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:24:39.756 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:24:50.816 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:24:50.818 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:24:54.816 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:25:05.894 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-07-19T17:25:05.895 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-07-19T17:25:05.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:05.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:09.008 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-07-19T17:25:09.009 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-07-19T17:25:09.863 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-19T17:25:09.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:12.976 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-19T17:25:15.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:15.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:18.064 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-07-19T17:25:18.065 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-07-19T17:25:18.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:22.036 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-19T17:25:24.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:24.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:27.120 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-07-19T17:25:27.121 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-07-19T17:25:28.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:31.125 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-19T17:25:33.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:33.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:36.176 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-07-19T17:25:36.177 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-07-19T17:25:37.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:40.208 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-19T17:25:42.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:42.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:45.232 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-07-19T17:25:45.236 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-07-19T17:25:46.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:49.264 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-19T17:25:51.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:51.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:54.288 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-07-19T17:25:55.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:25:58.324 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-19T17:26:00.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:26:04.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:26:51.280 WARNING:teuthology.provision.fog.smithi132:timed out
2023-07-19T17:26:57.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:26:57.632 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-19T17:26:57.633 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-19T17:26:57.917 INFO:teuthology.provision.fog.smithi132:Node is ready
2023-07-19T17:26:57.918 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2023-07-19T17:26:57.935 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2023-07-19T17:26:57.936 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2023-07-19T17:26:57.994 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2023-07-19T17:26:57.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-07-19T17:26:58.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2023-07-19T17:26:58.160 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2023-07-19T17:26:58.228 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2023-07-19T17:26:58.295 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-07-19T17:26:58.362 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-07-19T17:26:58.418 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:26:58.418 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:26:58.418 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:26:58.419 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:26:58.420 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:26:58.421 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2023-07-19T17:26:58.422 DEBUG:teuthology.parallel:result is None
2023-07-19T17:27:00.293 WARNING:teuthology.provision.fog.smithi143:timed out
2023-07-19T17:27:04.333 WARNING:teuthology.provision.fog.smithi105:timed out
2023-07-19T17:27:06.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:27:06.609 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-19T17:27:06.609 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-19T17:27:06.907 INFO:teuthology.provision.fog.smithi143:Node is ready
2023-07-19T17:27:06.907 DEBUG:teuthology.orchestra.run.smithi143:> hostname
2023-07-19T17:27:06.925 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2023-07-19T17:27:06.925 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts
2023-07-19T17:27:06.983 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2023-07-19T17:27:06.984 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2023-07-19T17:27:07.112 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts
2023-07-19T17:27:07.142 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts
2023-07-19T17:27:07.208 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname
2023-07-19T17:27:07.276 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2023-07-19T17:27:07.342 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2023-07-19T17:27:07.396 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:27:07.397 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:27:07.397 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel"
2023-07-19T17:27:07.397 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora"
2023-07-19T17:27:07.397 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.6"
2023-07-19T17:27:07.397 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:
2023-07-19T17:27:07.398 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:27:07.399 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:27:07.399 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:27:07.399 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:27:07.399 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2023-07-19T17:27:07.400 DEBUG:teuthology.parallel:result is None
2023-07-19T17:27:10.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:27:10.647 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-19T17:27:10.648 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-19T17:27:10.936 INFO:teuthology.provision.fog.smithi105:Node is ready
2023-07-19T17:27:10.936 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2023-07-19T17:27:10.954 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2023-07-19T17:27:10.955 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2023-07-19T17:27:11.009 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2023-07-19T17:27:11.010 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-07-19T17:27:11.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2023-07-19T17:27:11.150 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2023-07-19T17:27:11.217 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2023-07-19T17:27:11.285 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-07-19T17:27:11.351 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-07-19T17:27:11.407 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:27:11.407 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:27:11.408 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-07-19T17:27:11.408 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-07-19T17:27:11.408 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6"
2023-07-19T17:27:11.408 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:27:11.408 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:27:11.408 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:27:11.409 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:27:11.410 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:27:11.410 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:27:11.410 INFO:teuthology.provision.fog.smithi105:Deploy complete!
2023-07-19T17:27:11.410 DEBUG:teuthology.parallel:result is None
2023-07-19T17:27:11.590 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com
2023-07-19T17:27:11.592 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2023-07-19T17:27:11.592 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-19T17:27:11.624 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2023-07-19T17:27:11.625 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-19T17:27:11.650 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server
2023-07-19T17:27:11.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-07-19T17:27:11.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:27:11.716 DEBUG:teuthology.orchestra.run.smithi105:> true
2023-07-19T17:27:11.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com'
2023-07-19T17:27:11.785 DEBUG:teuthology.orchestra.run.smithi105:> uname -m
2023-07-19T17:27:11.840 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64
2023-07-19T17:27:11.841 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-07-19T17:27:11.896 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:27:11.897 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:27:11.897 INFO:teuthology.orchestra.run.smithi105.stdout:ID="rhel"
2023-07-19T17:27:11.897 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="fedora"
2023-07-19T17:27:11.897 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8.6"
2023-07-19T17:27:11.897 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:
2023-07-19T17:27:11.898 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:27:11.899 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:27:11.899 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:27:11.899 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:27:11.899 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-07-19T17:27:11.923 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2023-07-19T17:27:11.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-07-19T17:27:11.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:27:11.990 DEBUG:teuthology.orchestra.run.smithi132:> true
2023-07-19T17:27:12.117 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-07-19T17:27:12.118 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2023-07-19T17:27:12.176 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2023-07-19T17:27:12.176 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-07-19T17:27:12.233 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:27:12.233 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:27:12.234 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2023-07-19T17:27:12.234 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2023-07-19T17:27:12.234 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6"
2023-07-19T17:27:12.234 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:27:12.235 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:27:12.235 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-07-19T17:27:12.235 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:27:12.236 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:27:12.236 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:27:12.236 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:27:12.237 INFO:teuthology.orchestra.run.smithi132.stdout:
2023-07-19T17:27:12.237 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:27:12.237 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:27:12.237 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:27:12.238 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:27:12.238 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-07-19T17:27:12.350 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2023-07-19T17:27:12.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2023-07-19T17:27:12.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:27:12.416 DEBUG:teuthology.orchestra.run.smithi143:> true
2023-07-19T17:27:12.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com'
2023-07-19T17:27:12.445 DEBUG:teuthology.orchestra.run.smithi143:> uname -m
2023-07-19T17:27:12.502 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2023-07-19T17:27:12.503 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2023-07-19T17:27:12.561 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:27:12.561 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:27:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel"
2023-07-19T17:27:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora"
2023-07-19T17:27:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.6"
2023-07-19T17:27:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:27:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:27:12.562 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2023-07-19T17:27:12.563 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:27:12.563 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:27:12.563 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:27:12.563 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:27:12.563 INFO:teuthology.orchestra.run.smithi143.stdout:
2023-07-19T17:27:12.564 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:27:12.564 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:27:12.564 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:27:12.564 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:27:12.565 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2023-07-19T17:27:12.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:27:12.591 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:27:12.692 INFO:teuthology.dispatcher.supervisor:Running job 7344160
2023-07-19T17:27:12.692 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344160 --name pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/norstats}} -- /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344160/orig.config.yaml
2023-07-19T17:27:12.695 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344160
2023-07-19T17:27:12.696 INFO:teuthology.dispatcher.supervisor:Job PID: 10163
2023-07-19T17:27:12.696 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-19T17:29:12.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:29:12.698 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:31:12.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:31:12.776 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:33:12.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:33:12.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:35:12.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:35:12.924 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:37:13.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:37:13.011 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:39:13.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:39:13.087 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:41:13.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:41:13.158 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:43:13.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:43:13.231 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:45:13.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:45:13.305 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:47:13.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:47:13.404 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:49:13.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:49:13.471 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:51:13.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:51:13.539 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:53:13.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:53:13.620 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:55:13.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:55:13.696 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:57:13.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:57:13.789 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:59:13.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:59:13.961 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:59:14.036 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-19T17:59:14.191 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-19T17:59:14.191 INFO:teuthology.nuke:Checking targets against current locks
2023-07-19T17:59:14.247 DEBUG:teuthology.nuke:shortname: smithi105
2023-07-19T17:59:14.247 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-19T17:59:14.270 DEBUG:teuthology.nuke:shortname: smithi132
2023-07-19T17:59:14.270 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-19T17:59:14.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344160', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:22:13.931300', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-19T17:59:14.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344160', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:22:13.935364', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-19T17:59:14.298 DEBUG:teuthology.nuke:shortname: smithi143
2023-07-19T17:59:14.298 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-19T17:59:14.334 INFO:teuthology.orchestra.console:Power off smithi105
2023-07-19T17:59:14.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:59:14.344 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344160', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:22:13.933455', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-19T17:59:14.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:59:14.382 INFO:teuthology.orchestra.console:Power off smithi132
2023-07-19T17:59:14.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:59:14.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:59:14.427 INFO:teuthology.orchestra.console:Power off smithi143
2023-07-19T17:59:14.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:59:14.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:59:14.496 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-07-19T17:59:14.540 INFO:teuthology.orchestra.console:Power off for smithi132 completed
2023-07-19T17:59:14.576 INFO:teuthology.orchestra.console:Power off for smithi143 completed
2023-07-19T17:59:14.651 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-07-19T17:59:14.695 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com
2023-07-19T17:59:14.734 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com