2023-07-14T17:40:22.359 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e
2023-07-14T17:40:22.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:40:22.361 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:40:22.587 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff77e8595b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff77fa758b0>, signals=[15])
2023-07-14T17:40:22.588 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-07-14T17:40:22.589 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T17:40:22.589 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-14T17:40:22.615 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-07-14T17:40:22.616 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T17:40:22.616 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-07-14T17:40:22.618 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-07-14T17:40:22.640 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging
2023-07-14T17:40:22.640 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T17:40:22.640 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-07-14T17:40:22.641 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-07-14T17:40:22.666 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"}
2023-07-14T17:40:22.690 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T17:40:22.718 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T17:40:22.730 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T17:40:22.734 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T17:40:22.734 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5}
2023-07-14T17:40:22.761 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T17:40:22.761 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5}
2023-07-14T17:40:22.767 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T17:40:22.768 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 5}
2023-07-14T17:40:22.784 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6
2023-07-14T17:40:22.785 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:40:22.802 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6
2023-07-14T17:40:22.802 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:40:22.807 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.6
2023-07-14T17:40:22.807 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:40:22.829 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T17:40:22.844 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T17:40:22.851 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T17:40:22.865 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-07-14T17:40:22.876 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-07-14T17:40:22.886 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1}
2023-07-14T17:40:22.946 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:40:22.949 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:40:22.953 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:40:23.033 INFO:teuthology.orchestra.console:Power off smithi079
2023-07-14T17:40:23.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T17:40:23.050 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-14T17:40:23.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T17:40:23.063 INFO:teuthology.orchestra.console:Power off smithi153
2023-07-14T17:40:23.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T17:40:23.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:23.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:23.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:23.204 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-14T17:40:23.206 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2023-07-14T17:40:23.216 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2023-07-14T17:40:23.305 INFO:teuthology.orchestra.console:Power on smithi062
2023-07-14T17:40:23.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T17:40:23.315 INFO:teuthology.orchestra.console:Power on smithi079
2023-07-14T17:40:23.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T17:40:23.323 INFO:teuthology.orchestra.console:Power on smithi153
2023-07-14T17:40:23.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T17:40:23.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:23.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:23.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:27.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:27.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:27.380 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:27.592 INFO:teuthology.orchestra.console:Power on for smithi153 completed
2023-07-14T17:40:27.693 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish
2023-07-14T17:40:27.693 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:40:31.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:32.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:32.687 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2023-07-14T17:40:32.788 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-07-14T17:40:32.788 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:40:47.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T17:40:47.805 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:40:52.923 INFO:teuthology.orchestra.console:Power on for smithi079 completed
2023-07-14T17:40:53.024 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-07-14T17:40:53.024 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:41:07.618 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:41:07.619 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:41:13.247 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:41:28.360 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:41:28.362 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:41:28.363 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:41:43.480 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:41:43.482 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:41:53.494 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:42:13.508 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:42:18.513 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:42:18.515 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:42:43.618 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:42:43.619 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:42:43.620 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:43:13.703 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-14T17:43:13.705 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-14T17:43:13.708 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:43:13.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:18.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:23.785 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-14T17:43:26.867 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-14T17:43:29.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:32.848 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-14T17:43:32.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:33.997 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None
2023-07-14T17:43:34.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:37.076 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-14T17:43:37.136 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-14T17:43:38.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:43.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:48.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:48.859 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-14T17:43:51.920 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-14T17:43:51.921 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-14T17:43:54.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:43:59.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:44:04.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:44:09.875 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-14T17:44:12.944 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153
2023-07-14T17:44:15.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:44:20.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:44:39.284 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-14T17:44:45.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:44:50.634 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T17:44:50.635 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T17:44:50.894 INFO:teuthology.provision.fog.smithi079:Node is ready
2023-07-14T17:44:50.894 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2023-07-14T17:44:50.912 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2023-07-14T17:44:50.912 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2023-07-14T17:44:50.970 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2023-07-14T17:44:50.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-07-14T17:44:51.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2023-07-14T17:44:51.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2023-07-14T17:44:51.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2023-07-14T17:44:51.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-07-14T17:44:51.322 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-07-14T17:44:51.378 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:44:51.378 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:44:51.379 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2023-07-14T17:44:51.379 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2023-07-14T17:44:51.379 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6"
2023-07-14T17:44:51.379 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:44:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:44:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-07-14T17:44:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:44:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:44:51.380 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:44:51.381 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:44:51.381 INFO:teuthology.orchestra.run.smithi079.stdout:
2023-07-14T17:44:51.381 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:44:51.381 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:44:51.382 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:44:51.382 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:44:51.383 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2023-07-14T17:44:51.385 DEBUG:teuthology.parallel:result is None
2023-07-14T17:45:04.884 WARNING:teuthology.provision.fog.smithi062:timed out
2023-07-14T17:45:10.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:45:16.115 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T17:45:16.116 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T17:45:16.422 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-07-14T17:45:16.423 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-07-14T17:45:16.441 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062
2023-07-14T17:45:16.442 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062 /etc/hosts
2023-07-14T17:45:16.502 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-07-14T17:45:16.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-14T17:45:16.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062/smithi062/g' /etc/hosts
2023-07-14T17:45:16.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-07-14T17:45:16.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062/smithi062/g' /etc/hostname
2023-07-14T17:45:16.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-14T17:45:16.852 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-14T17:45:16.909 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:45:16.910 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:45:16.910 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2023-07-14T17:45:16.910 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2023-07-14T17:45:16.910 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6"
2023-07-14T17:45:16.910 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:45:16.911 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:45:16.911 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-14T17:45:16.911 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:45:16.911 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:45:16.911 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:45:16.911 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:45:16.912 INFO:teuthology.orchestra.run.smithi062.stdout:
2023-07-14T17:45:16.912 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:45:16.912 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:45:16.912 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:45:16.913 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:45:16.913 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-07-14T17:45:16.914 DEBUG:teuthology.parallel:result is None
2023-07-14T17:45:25.504 WARNING:teuthology.provision.fog.smithi153:timed out
2023-07-14T17:45:31.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:45:31.868 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T17:45:31.868 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T17:45:32.167 INFO:teuthology.provision.fog.smithi153:Node is ready
2023-07-14T17:45:32.167 DEBUG:teuthology.orchestra.run.smithi153:> hostname
2023-07-14T17:45:32.185 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153
2023-07-14T17:45:32.186 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153 /etc/hosts
2023-07-14T17:45:32.245 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153
2023-07-14T17:45:32.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-07-14T17:45:32.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153/smithi153/g' /etc/hosts
2023-07-14T17:45:32.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts
2023-07-14T17:45:32.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153/smithi153/g' /etc/hostname
2023-07-14T17:45:32.532 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153
2023-07-14T17:45:32.598 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-07-14T17:45:32.656 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:45:32.656 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:45:32.656 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2023-07-14T17:45:32.656 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2023-07-14T17:45:32.657 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6"
2023-07-14T17:45:32.657 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:45:32.657 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:45:32.657 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-07-14T17:45:32.657 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:45:32.658 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:45:32.658 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:45:32.658 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:45:32.659 INFO:teuthology.orchestra.run.smithi153.stdout:
2023-07-14T17:45:32.659 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:45:32.659 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:45:32.659 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:45:32.659 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:45:32.660 INFO:teuthology.provision.fog.smithi153:Deploy complete!
2023-07-14T17:45:32.660 DEBUG:teuthology.parallel:result is None
2023-07-14T17:45:42.858 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-07-14T17:45:42.859 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-14T17:45:42.883 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2023-07-14T17:45:42.884 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com
2023-07-14T17:45:42.886 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-07-14T17:45:42.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-07-14T17:45:42.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:45:42.955 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-07-14T17:45:43.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-07-14T17:45:43.091 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-07-14T17:45:43.149 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-07-14T17:45:43.149 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-14T17:45:43.207 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:45:43.207 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:45:43.207 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:45:43.208 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:45:43.209 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:45:43.210 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-14T17:45:43.233 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2023-07-14T17:45:43.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-07-14T17:45:43.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:45:43.300 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-07-14T17:45:43.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-07-14T17:45:43.438 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2023-07-14T17:45:43.494 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2023-07-14T17:45:43.495 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-07-14T17:45:43.551 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:45:43.551 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:45:43.551 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:45:43.552 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:45:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:45:43.554 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-07-14T17:45:43.575 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server
2023-07-14T17:45:43.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-07-14T17:45:43.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T17:45:43.641 DEBUG:teuthology.orchestra.run.smithi153:> true
2023-07-14T17:45:43.775 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com'
2023-07-14T17:45:43.775 DEBUG:teuthology.orchestra.run.smithi153:> uname -m
2023-07-14T17:45:43.833 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64
2023-07-14T17:45:43.834 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release
2023-07-14T17:45:43.894 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux"
2023-07-14T17:45:43.894 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)"
2023-07-14T17:45:43.894 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel"
2023-07-14T17:45:43.895 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora"
2023-07-14T17:45:43.895 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6"
2023-07-14T17:45:43.895 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8"
2023-07-14T17:45:43.895 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-14T17:45:43.895 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31"
2023-07-14T17:45:43.895 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-14T17:45:43.896 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/"
2023-07-14T17:45:43.896 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-14T17:45:43.896 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-14T17:45:43.896 INFO:teuthology.orchestra.run.smithi153.stdout:
2023-07-14T17:45:43.896 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-14T17:45:43.896 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-14T17:45:43.897 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-14T17:45:43.897 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-14T17:45:43.897 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server
2023-07-14T17:45:43.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:45:43.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:45:44.273 INFO:teuthology.dispatcher.supervisor:Running job 7337994
2023-07-14T17:45:44.273 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_aa6a80e6cc655fff48452a7eca02070e61d074fc/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337994 --name pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337994/orig.config.yaml
2023-07-14T17:45:44.277 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337994
2023-07-14T17:45:44.278 INFO:teuthology.dispatcher.supervisor:Job PID: 1278
2023-07-14T17:45:44.279 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-14T17:47:44.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:47:44.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:49:49.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:49:49.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:51:49.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:51:49.725 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:53:54.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:53:54.901 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:56:00.077 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:56:00.078 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T17:58:05.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T17:58:05.253 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:00:08.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:00:08.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:02:08.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:02:08.866 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:04:14.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:04:14.023 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:06:19.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:06:19.204 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:08:24.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:08:24.319 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:10:29.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:10:29.473 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:12:32.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:12:32.903 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:14:38.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:14:38.083 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:16:38.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:16:38.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:18:38.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:18:38.430 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:20:40.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T18:20:40.815 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T18:20:45.889 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-14T18:21:01.052 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-14T18:21:01.052 INFO:teuthology.nuke:Checking targets against current locks
2023-07-14T18:21:16.125 DEBUG:teuthology.nuke:shortname: smithi062
2023-07-14T18:21:16.126 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T18:21:31.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:40:21.530645', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-14T18:21:31.172 DEBUG:teuthology.nuke:shortname: smithi079
2023-07-14T18:21:31.172 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T18:21:31.201 DEBUG:teuthology.nuke:shortname: smithi153
2023-07-14T18:21:31.202 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T18:21:31.203 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:40:21.532106', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-14T18:21:31.235 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-14T18:21:31.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T18:21:31.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-14_16:44:47-fs:workload-wip-pdonnell-testing-20230714.134335-distro-default-smithi/7337994', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 17:40:21.526186', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-14T18:21:31.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:21:31.275 INFO:teuthology.orchestra.console:Power off smithi079
2023-07-14T18:21:31.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T18:21:36.323 INFO:teuthology.orchestra.console:Power off smithi153
2023-07-14T18:21:36.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T18:21:36.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:21:36.390 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-14T18:21:36.467 INFO:teuthology.orchestra.console:Power off for smithi153 completed
2023-07-14T18:21:36.547 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-07-14T18:21:36.622 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com
2023-07-14T18:21:41.302 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:21:46.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:21:51.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:21:56.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:01.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:06.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:11.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:16.993 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:22.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:27.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:32.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:37.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:42.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:47.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:52.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T18:22:53.892 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-14T18:22:53.893 ERROR:teuthology.orchestra.console:Failed to power off smithi079
2023-07-14T18:23:03.967 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com