2023-07-17T11:40:40.689 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-17T11:40:40.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:40:40.691 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:40:40.851 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdc154035b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdc14dc4e50>, signals=[15])
2023-07-17T11:40:40.853 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2023-07-17T11:40:40.855 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2023-07-17T11:40:40.855 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2023-07-17T11:40:45.886 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2023-07-17T11:40:45.886 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2023-07-17T11:40:45.886 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-07-17T11:40:45.888 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"}
2023-07-17T11:40:45.911 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"}
2023-07-17T11:40:45.962 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-17T11:40:45.991 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-17T11:40:46.012 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_8.stream (ID 3)
2023-07-17T11:40:46.012 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 3}
2023-07-17T11:40:46.028 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_8.stream (ID 3)
2023-07-17T11:40:46.028 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 3}
2023-07-17T11:40:46.067 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream
2023-07-17T11:40:46.067 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:40:46.078 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream
2023-07-17T11:40:46.078 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:40:46.124 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"}
2023-07-17T11:40:46.133 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"}
2023-07-17T11:40:46.165 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1}
2023-07-17T11:40:46.178 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1}
2023-07-17T11:40:46.233 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:40:46.240 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:40:46.330 INFO:teuthology.orchestra.console:Power off smithi179
2023-07-17T11:40:46.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T11:40:46.349 INFO:teuthology.orchestra.console:Power off smithi188
2023-07-17T11:40:46.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T11:40:46.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:46.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:50.388 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:50.398 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:54.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:54.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:59.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:59.626 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:40:59.839 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2023-07-17T11:40:59.940 INFO:teuthology.orchestra.console:Power on smithi188
2023-07-17T11:40:59.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-17T11:40:59.963 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:03.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:04.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:09.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:09.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:14.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:14.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:19.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:19.537 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2023-07-17T11:41:19.638 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2023-07-17T11:41:19.638 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:41:21.082 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:26.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:31.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:36.171 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:41:51.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:41:56.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:42:01.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:42:06.264 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:42:06.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:42:11.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:42:12.750 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-17T11:42:12.751 ERROR:teuthology.orchestra.console:Failed to power off smithi179
2023-07-17T11:42:12.751 INFO:teuthology.orchestra.console:Power on smithi179
2023-07-17T11:42:12.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-17T11:42:16.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:42:20.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:42:21.321 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:42:26.422 INFO:teuthology.orchestra.console:Power on for smithi179 completed
2023-07-17T11:42:26.522 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2023-07-17T11:42:26.523 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:42:41.388 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:42:46.600 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:43:01.452 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:43:06.668 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:43:16.520 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:43:21.740 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:43:31.580 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:43:41.804 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:43:51.652 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-17T11:43:56.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:43:59.792 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-17T11:44:01.873 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:44:06.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:44:14.960 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-17T11:44:20.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:44:26.953 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:44:29.044 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-17T11:44:35.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:44:38.128 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-17T11:44:42.012 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:44:46.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:45:06.964 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None
2023-07-17T11:45:11.969 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-17T11:45:12.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:45:15.092 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-07-17T11:45:17.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:45:22.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:45:28.439 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-17T11:45:28.440 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-17T11:45:31.056 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-07-17T11:45:37.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:45:41.268 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-07-17T11:45:44.789 INFO:teuthology.provision.fog.smithi188:Node is ready
2023-07-17T11:45:44.790 DEBUG:teuthology.orchestra.run.smithi188:> hostname
2023-07-17T11:45:44.814 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2023-07-17T11:45:44.814 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts
2023-07-17T11:45:44.876 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2023-07-17T11:45:44.876 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-07-17T11:45:44.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts
2023-07-17T11:45:45.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts
2023-07-17T11:45:45.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname
2023-07-17T11:45:45.148 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-07-17T11:45:45.216 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-07-17T11:45:45.273 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-07-17T11:45:45.274 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2023-07-17T11:45:45.274 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-07-17T11:45:45.274 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-07-17T11:45:45.274 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2023-07-17T11:45:45.274 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2023-07-17T11:45:45.274 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-17T11:45:45.275 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-07-17T11:45:45.275 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-17T11:45:45.275 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-07-17T11:45:45.275 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-17T11:45:45.275 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-17T11:45:45.275 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-17T11:45:45.276 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2023-07-17T11:45:45.278 DEBUG:teuthology.parallel:result is None
2023-07-17T11:45:47.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:45:55.344 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-07-17T11:46:01.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:46:09.424 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-07-17T11:46:15.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:46:23.504 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2023-07-17T11:46:29.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:47:31.056 WARNING:teuthology.provision.fog.smithi179:timed out
2023-07-17T11:47:37.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:47:37.353 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-17T11:47:37.353 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-17T11:47:37.588 INFO:teuthology.provision.fog.smithi179:Node is ready
2023-07-17T11:47:37.588 DEBUG:teuthology.orchestra.run.smithi179:> hostname
2023-07-17T11:47:37.607 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2023-07-17T11:47:37.607 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts
2023-07-17T11:47:37.666 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2023-07-17T11:47:37.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2023-07-17T11:47:37.785 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts
2023-07-17T11:47:37.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts
2023-07-17T11:47:37.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname
2023-07-17T11:47:37.954 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2023-07-17T11:47:38.025 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2023-07-17T11:47:38.083 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream"
2023-07-17T11:47:38.084 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8"
2023-07-17T11:47:38.084 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos"
2023-07-17T11:47:38.084 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/"
2023-07-17T11:47:38.085 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-17T11:47:38.086 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-17T11:47:38.086 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-17T11:47:38.086 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2023-07-17T11:47:38.087 DEBUG:teuthology.parallel:result is None
2023-07-17T11:47:40.705 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2023-07-17T11:47:40.706 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-17T11:47:44.959 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2023-07-17T11:47:44.960 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-17T11:47:44.979 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2023-07-17T11:47:44.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2023-07-17T11:47:44.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:47:45.046 DEBUG:teuthology.orchestra.run.smithi179:> true
2023-07-17T11:47:45.122 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com'
2023-07-17T11:47:45.122 DEBUG:teuthology.orchestra.run.smithi179:> uname -m
2023-07-17T11:47:45.183 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2023-07-17T11:47:45.183 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2023-07-17T11:47:45.245 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream"
2023-07-17T11:47:45.245 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8"
2023-07-17T11:47:45.246 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos"
2023-07-17T11:47:45.246 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora"
2023-07-17T11:47:45.247 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8"
2023-07-17T11:47:45.247 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2023-07-17T11:47:45.247 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-17T11:47:45.248 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2023-07-17T11:47:45.248 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-17T11:47:45.248 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/"
2023-07-17T11:47:45.248 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-17T11:47:45.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-17T11:47:45.249 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-17T11:47:45.250 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2023-07-17T11:47:50.284 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2023-07-17T11:47:50.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-17T11:47:50.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:47:50.365 DEBUG:teuthology.orchestra.run.smithi188:> true
2023-07-17T11:47:50.508 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-17T11:47:50.508 DEBUG:teuthology.orchestra.run.smithi188:> uname -m
2023-07-17T11:47:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2023-07-17T11:47:50.569 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-07-17T11:47:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-07-17T11:47:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2023-07-17T11:47:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-07-17T11:47:50.629 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-07-17T11:47:50.630 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-17T11:47:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-17T11:47:50.631 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-17T11:47:50.631 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-07-17T11:47:55.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:47:55.525 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:47:55.634 INFO:teuthology.dispatcher.supervisor:Running job 7341334
2023-07-17T11:47:55.634 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_akupczyk@teuthology --archive /home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341334 --name akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341334/orig.config.yaml
2023-07-17T11:47:55.638 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341334
2023-07-17T11:47:55.639 INFO:teuthology.dispatcher.supervisor:Job PID: 28323
2023-07-17T11:47:55.639 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-17T11:49:55.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:49:55.739 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:52:00.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:52:00.891 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:54:05.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:54:05.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:56:10.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:56:10.911 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:58:16.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:58:16.090 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T12:00:18.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T12:00:18.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T12:02:23.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T12:02:23.749 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T12:04:28.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T12:04:28.841 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T12:06:34.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T12:06:34.020 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T12:08:34.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T12:08:34.174 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T12:08:34.253 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-17T12:08:34.352 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-17T12:08:34.353 INFO:teuthology.nuke:Checking targets against current locks
2023-07-17T12:08:34.409 DEBUG:teuthology.nuke:shortname: smithi179
2023-07-17T12:08:34.410 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-17T12:08:34.430 DEBUG:teuthology.nuke:shortname: smithi188
2023-07-17T12:08:34.430 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-17T12:08:34.436 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341334', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-17 11:40:39.767548', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2N0utrirgyP1KNctCOPm8TBKFjEUNhlj/7yPRJ1IRCgMczY1Be1ENdcJME3QO6OUam4/zL0X/vjHu65Gd8H6wds6UbxgSijFd4w12wHK7VQrPWf4tIveA6PSv6mo3EvYPm5UgmOC50poGOY2zICgk8QFr2bm2lzrEpHU/ehFvBJ1anmrRhimLzDjjAp/LhiXWVWatOLGyxiNSDjDN7RI/gNmJrlewbCtfPbPepTPtqHhQ8Hy2n6tMl/GYP/oN4xyhEApUagV6lQsg6obUmEisYViwhwgNfEBEcp2mHjgDaGQv00OpAhadhakR8hJHACCB7tTQGkzfguxn2cHBvMCeNgOymDav2ryd8VCdX+oFw1x4PV6N8IeNpBX7FMqnPxluo/tre4PGiIiIL8c9JCRNflVB6JJ1wUQPT403jE+wYuLH68Ch6q13pUkJEV3L7c34t5AbRRGjeRAtK+svdmSeTfkrS3iyvGm7uGzIDFK3efBNMMyv7HnRJIVaisdVNvM='}
2023-07-17T12:08:34.452 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341334', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-17 11:40:39.766287', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAimljdtcrcmHOQHVSc9GS2aS953awmJDFgtYomPIbyIoJt7joSFYf6LvlR4dzfIZd2YM8Jm4uW1Fqe5G8GuoCc='}
2023-07-17T12:08:34.481 INFO:teuthology.orchestra.console:Power off smithi179
2023-07-17T12:08:34.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T12:08:34.503 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T12:08:34.519 INFO:teuthology.orchestra.console:Power off smithi188
2023-07-17T12:08:34.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T12:08:34.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T12:08:34.629 INFO:teuthology.orchestra.console:Power off for smithi179 completed
2023-07-17T12:08:34.660 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2023-07-17T12:08:34.785 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com
2023-07-17T12:08:34.811 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com