2023-07-19T17:26:56.950 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-19T17:26:56.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:26:56.953 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:26:57.154 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe7ec5af5b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe7ed7c98b0>, signals=[15])
2023-07-19T17:26:57.155 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2023-07-19T17:26:57.156 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2023-07-19T17:26:57.156 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-07-19T17:26:57.183 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-07-19T17:26:57.183 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-07-19T17:26:57.184 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-19T17:26:57.185 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"}
2023-07-19T17:26:57.207 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-07-19T17:26:57.207 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-07-19T17:26:57.208 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-07-19T17:26:57.209 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-07-19T17:26:57.233 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-07-19T17:26:57.262 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-19T17:26:57.292 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-19T17:26:57.305 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-19T17:26:57.308 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-19T17:26:57.309 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 5}
2023-07-19T17:26:57.331 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-19T17:26:57.331 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5}
2023-07-19T17:26:57.345 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6
2023-07-19T17:26:57.346 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:26:57.352 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-19T17:26:57.353 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 5}
2023-07-19T17:26:57.381 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6
2023-07-19T17:26:57.382 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:26:57.389 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"}
2023-07-19T17:26:57.403 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6
2023-07-19T17:26:57.403 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:26:57.432 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1}
2023-07-19T17:26:57.435 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-07-19T17:26:57.447 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-07-19T17:26:57.471 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-07-19T17:26:57.476 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-07-19T17:26:57.485 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:26:57.517 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:26:57.521 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:26:57.577 INFO:teuthology.orchestra.console:Power off smithi033
2023-07-19T17:26:57.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:26:57.594 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-19T17:26:57.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:26:57.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:26:57.621 INFO:teuthology.orchestra.console:Power off smithi093
2023-07-19T17:26:57.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T17:26:57.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:26:57.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:26:57.731 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2023-07-19T17:26:57.755 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-19T17:26:57.765 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-07-19T17:26:57.833 INFO:teuthology.orchestra.console:Power on smithi033
2023-07-19T17:26:57.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-19T17:26:57.855 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:26:57.866 INFO:teuthology.orchestra.console:Power on smithi062
2023-07-19T17:26:57.866 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-19T17:26:57.875 INFO:teuthology.orchestra.console:Power on smithi093
2023-07-19T17:26:57.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-19T17:26:57.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:26:57.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:27:01.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:27:01.914 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:27:01.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T17:27:02.103 INFO:teuthology.orchestra.console:Power on for smithi033 completed
2023-07-19T17:27:02.131 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2023-07-19T17:27:02.141 INFO:teuthology.orchestra.console:Power on for smithi093 completed
2023-07-19T17:27:02.204 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2023-07-19T17:27:02.205 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:27:02.232 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-07-19T17:27:02.233 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:27:02.243 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-07-19T17:27:02.243 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:27:17.280 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:27:17.283 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:27:17.294 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:27:32.353 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:27:32.355 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:27:32.358 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:27:47.432 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:27:47.433 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:27:47.434 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:28:02.512 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:28:02.513 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:28:02.514 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:28:17.592 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:28:17.594 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:28:17.594 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:28:32.676 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:28:32.677 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:28:32.678 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:28:47.764 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:28:47.765 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:28:47.766 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:29:02.840 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:29:02.842 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:29:02.852 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:29:17.932 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:29:17.933 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:29:17.934 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:29:33.024 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:29:33.026 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:29:33.026 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-19T17:29:33.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:29:36.176 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-19T17:29:42.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:29:45.232 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-19T17:29:48.092 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-19T17:29:48.106 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-19T17:29:48.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:29:48.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:29:51.216 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:29:51.217 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-19T17:29:51.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:29:54.288 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-19T17:29:57.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:29:57.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:00.272 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:30:00.273 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-19T17:30:00.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:03.344 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-19T17:30:06.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:06.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:09.328 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:30:09.329 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-19T17:30:09.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:12.404 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-19T17:30:15.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:15.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:18.388 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:30:18.389 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-19T17:30:18.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:24.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:24.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:27.444 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:30:27.476 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-19T17:30:33.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:33.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:36.533 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-19T17:30:36.533 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:30:42.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:42.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:30:50.385 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-19T17:30:50.386 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-19T17:30:50.753 INFO:teuthology.provision.fog.smithi033:Node is ready
2023-07-19T17:30:50.754 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2023-07-19T17:30:50.770 INFO:teuthology.orchestra.run.smithi033.stdout:smithi022
2023-07-19T17:30:50.771 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi022 /etc/hosts
2023-07-19T17:30:50.829 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-07-19T17:30:50.829 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-07-19T17:30:51.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi022/smithi033/g' /etc/hosts
2023-07-19T17:30:51.042 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.22/172.21.15.33/g' /etc/hosts
2023-07-19T17:30:51.120 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi022/smithi033/g' /etc/hostname
2023-07-19T17:30:51.205 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-07-19T17:30:51.274 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-07-19T17:30:51.330 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:30:51.331 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:30:51.331 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-07-19T17:30:51.331 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-07-19T17:30:51.332 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-07-19T17:30:51.332 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:30:51.332 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:30:51.333 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-07-19T17:30:51.333 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:30:51.333 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:30:51.334 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:30:51.334 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:30:51.334 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-07-19T17:30:51.334 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:30:51.335 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:30:51.335 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:30:51.335 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:30:51.336 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2023-07-19T17:30:51.338 DEBUG:teuthology.parallel:result is None
2023-07-19T17:31:01.108 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:31:07.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:10.192 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:31:16.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:19.248 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-19T17:31:25.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:25.468 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-19T17:31:25.469 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-19T17:31:25.741 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-07-19T17:31:25.742 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-07-19T17:31:25.761 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-07-19T17:31:25.762 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-07-19T17:31:25.821 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-07-19T17:31:25.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-19T17:31:25.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-07-19T17:31:25.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-07-19T17:31:26.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-07-19T17:31:26.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-19T17:31:26.170 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-19T17:31:26.226 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:31:26.227 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-19T17:31:26.228 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:31:26.228 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:31:26.228 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:31:26.228 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:31:26.228 INFO:teuthology.orchestra.run.smithi062.stdout:
2023-07-19T17:31:26.229 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:31:26.229 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:31:26.229 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:31:26.229 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:31:26.229 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-07-19T17:31:26.230 DEBUG:teuthology.parallel:result is None
2023-07-19T17:31:42.538 WARNING:teuthology.provision.fog.smithi093:timed out
2023-07-19T17:31:48.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:48.865 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-19T17:31:48.866 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-19T17:31:49.184 INFO:teuthology.provision.fog.smithi093:Node is ready
2023-07-19T17:31:49.185 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2023-07-19T17:31:49.205 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2023-07-19T17:31:49.205 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts
2023-07-19T17:31:49.264 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2023-07-19T17:31:49.265 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-07-19T17:31:49.393 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts
2023-07-19T17:31:49.426 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2023-07-19T17:31:49.499 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname
2023-07-19T17:31:49.571 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2023-07-19T17:31:49.640 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-07-19T17:31:49.698 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:31:49.698 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:31:49.699 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-07-19T17:31:49.699 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-07-19T17:31:49.699 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2023-07-19T17:31:49.699 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:31:49.699 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:31:49.699 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:31:49.700 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:31:49.701 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:31:49.701 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:31:49.701 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2023-07-19T17:31:49.702 DEBUG:teuthology.parallel:result is None
2023-07-19T17:31:49.913 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2023-07-19T17:31:49.914 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-07-19T17:31:49.914 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2023-07-19T17:31:49.916 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2023-07-19T17:31:49.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-07-19T17:31:49.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:49.985 DEBUG:teuthology.orchestra.run.smithi033:> true
2023-07-19T17:31:50.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-07-19T17:31:50.123 DEBUG:teuthology.orchestra.run.smithi033:> uname -m
2023-07-19T17:31:50.181 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2023-07-19T17:31:50.181 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-07-19T17:31:50.240 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:31:50.240 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:31:50.241 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-07-19T17:31:50.241 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-07-19T17:31:50.241 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-07-19T17:31:50.242 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:31:50.242 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:31:50.242 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-07-19T17:31:50.243 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:31:50.243 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:31:50.243 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:31:50.243 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:31:50.244 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-07-19T17:31:50.244 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:31:50.244 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:31:50.244 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:31:50.245 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:31:50.245 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-07-19T17:31:50.269 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-07-19T17:31:50.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-07-19T17:31:50.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:50.340 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-07-19T17:31:50.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-07-19T17:31:50.413 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-07-19T17:31:50.472 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-07-19T17:31:50.473 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-19T17:31:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:31:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:31:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2023-07-19T17:31:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2023-07-19T17:31:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6"
2023-07-19T17:31:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:31:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:31:50.535 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-19T17:31:50.535 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:31:50.535 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:31:50.535 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:31:50.536 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:31:50.536 INFO:teuthology.orchestra.run.smithi062.stdout:
2023-07-19T17:31:50.536 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:31:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:31:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:31:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:31:50.538 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-19T17:31:50.560 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2023-07-19T17:31:50.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-07-19T17:31:50.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-19T17:31:50.627 DEBUG:teuthology.orchestra.run.smithi093:> true
2023-07-19T17:31:50.696 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2023-07-19T17:31:50.696 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2023-07-19T17:31:50.755 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2023-07-19T17:31:50.756 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2023-07-19T17:31:50.813 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2023-07-19T17:31:50.814 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2023-07-19T17:31:50.814 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2023-07-19T17:31:50.814 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2023-07-19T17:31:50.814 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2023-07-19T17:31:50.814 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-19T17:31:50.815 INFO:teuthology.orchestra.run.smithi093.stdout:
2023-07-19T17:31:50.816 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-19T17:31:50.816 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-19T17:31:50.816 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-19T17:31:50.816 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-19T17:31:50.817 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-07-19T17:31:50.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:31:50.845 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:31:50.965 INFO:teuthology.dispatcher.supervisor:Running job 7344163
2023-07-19T17:31:50.966 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344163 --name pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/distributed export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344163/orig.config.yaml
2023-07-19T17:31:50.969 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344163
2023-07-19T17:31:50.970 INFO:teuthology.dispatcher.supervisor:Job PID: 15524
2023-07-19T17:31:50.971 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-19T17:33:51.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:33:51.073 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:35:51.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:35:51.261 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:37:51.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:37:51.430 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:39:51.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:39:51.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:41:51.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:41:51.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:43:51.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:43:51.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:45:52.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:45:52.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:47:52.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:47:52.286 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:49:52.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:49:52.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:51:52.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:51:52.635 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:53:52.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:53:52.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:55:52.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:55:52.994 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:57:53.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:57:53.174 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T17:59:53.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T17:59:53.361 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:01:53.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:01:53.534 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:03:53.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:03:53.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:05:53.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:05:53.882 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:07:54.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:07:54.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:09:54.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:09:54.230 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:11:54.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:11:54.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:13:54.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-19T18:13:54.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-19T18:13:54.661 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-19T18:13:54.826 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-19T18:13:54.827 INFO:teuthology.nuke:Checking targets against current locks
2023-07-19T18:13:54.885 DEBUG:teuthology.nuke:shortname: smithi033
2023-07-19T18:13:54.885 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-19T18:13:54.910 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344163', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:26:56.067135', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-19T18:13:54.912 DEBUG:teuthology.nuke:shortname: smithi062
2023-07-19T18:13:54.913 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-19T18:13:54.934 DEBUG:teuthology.nuke:shortname: smithi093
2023-07-19T18:13:54.934 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-19T18:13:54.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344163', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:26:56.065736', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-19T18:13:54.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-19_15:51:11-fs:workload-wip-pdonnell-testing-20230719.005624-distro-default-smithi/7344163', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 17:26:56.064277', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-19T18:13:54.968 INFO:teuthology.orchestra.console:Power off smithi033
2023-07-19T18:13:54.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T18:13:54.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T18:13:55.013 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-19T18:13:55.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T18:13:55.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T18:13:55.057 INFO:teuthology.orchestra.console:Power off smithi093
2023-07-19T18:13:55.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-19T18:13:55.082 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-19T18:13:55.125 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2023-07-19T18:13:55.169 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-19T18:13:55.204 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-07-19T18:13:55.285 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2023-07-19T18:13:55.326 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-07-19T18:13:55.358 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com