2023-07-13T23:16:37.314 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb
2023-07-13T23:16:37.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:16:37.315 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:16:37.475 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fca3f5f9520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fca3f62ff70>, signals=[15])
2023-07-13T23:16:37.476 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2023-07-13T23:16:37.477 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2023-07-13T23:16:37.477 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-07-13T23:16:37.504 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2023-07-13T23:16:37.504 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2023-07-13T23:16:37.504 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-07-13T23:16:37.506 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"}
2023-07-13T23:16:37.528 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"}
2023-07-13T23:16:37.580 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-13T23:16:37.608 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-13T23:16:37.631 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_8.stream (ID 3)
2023-07-13T23:16:37.631 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 3}
2023-07-13T23:16:37.647 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_8.stream (ID 3)
2023-07-13T23:16:37.647 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 3}
2023-07-13T23:16:37.676 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream
2023-07-13T23:16:37.676 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:16:37.690 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 8.stream
2023-07-13T23:16:37.691 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:16:37.768 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"}
2023-07-13T23:16:37.785 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"}
2023-07-13T23:16:37.809 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1}
2023-07-13T23:16:37.829 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1}
2023-07-13T23:16:37.870 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:16:37.903 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:16:38.024 INFO:teuthology.orchestra.console:Power off smithi029
2023-07-13T23:16:38.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-13T23:16:38.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:38.072 INFO:teuthology.orchestra.console:Power off smithi178
2023-07-13T23:16:38.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-13T23:16:38.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:38.183 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2023-07-13T23:16:38.217 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2023-07-13T23:16:38.285 INFO:teuthology.orchestra.console:Power on smithi029
2023-07-13T23:16:38.286 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-13T23:16:38.310 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:38.319 INFO:teuthology.orchestra.console:Power on smithi178
2023-07-13T23:16:38.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-13T23:16:38.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:42.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:42.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:42.543 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2023-07-13T23:16:42.644 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2023-07-13T23:16:42.645 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:16:46.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:16:46.690 INFO:teuthology.orchestra.console:Power on for smithi178 completed
2023-07-13T23:16:46.791 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2023-07-13T23:16:46.792 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:16:57.760 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:17:01.880 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:17:12.872 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:17:16.980 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:17:27.963 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:17:32.084 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:17:43.052 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:17:47.174 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:17:58.148 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:18:02.270 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:18:13.224 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:18:17.353 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:18:28.316 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:18:32.424 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:18:43.400 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:18:47.504 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:18:58.473 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:19:02.584 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:19:13.562 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:19:17.648 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:19:28.644 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:19:32.710 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:19:43.735 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:19:47.773 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:19:58.812 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-13T23:19:58.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:01.940 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-13T23:20:02.838 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None
2023-07-13T23:20:02.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:05.968 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:20:07.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:10.992 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-13T23:20:11.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:15.024 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:20:16.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:20.053 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-13T23:20:21.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:24.080 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:20:26.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:29.136 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-13T23:20:30.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:33.136 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:20:35.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:38.192 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-13T23:20:39.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:42.192 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:20:44.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:47.248 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-13T23:20:48.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:51.248 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:20:53.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:20:57.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:21:00.308 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:21:06.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:21:09.396 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:21:15.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:21:33.808 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:21:39.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:21:42.868 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-07-13T23:21:48.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:21:51.025 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-13T23:21:51.026 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-13T23:21:53.254 WARNING:teuthology.provision.fog.smithi029:timed out
2023-07-13T23:21:59.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:21:59.547 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-13T23:21:59.548 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-13T23:21:59.797 INFO:teuthology.provision.fog.smithi029:Node is ready
2023-07-13T23:21:59.797 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2023-07-13T23:21:59.818 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2023-07-13T23:21:59.819 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2023-07-13T23:21:59.879 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2023-07-13T23:21:59.879 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-07-13T23:21:59.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2023-07-13T23:22:00.028 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2023-07-13T23:22:00.097 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2023-07-13T23:22:00.166 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-07-13T23:22:00.235 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-07-13T23:22:00.293 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2023-07-13T23:22:00.294 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2023-07-13T23:22:00.294 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2023-07-13T23:22:00.294 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2023-07-13T23:22:00.294 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2023-07-13T23:22:00.294 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2023-07-13T23:22:00.294 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-13T23:22:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-07-13T23:22:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-13T23:22:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2023-07-13T23:22:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-13T23:22:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-13T23:22:00.295 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-13T23:22:00.296 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2023-07-13T23:22:00.297 DEBUG:teuthology.parallel:result is None
2023-07-13T23:22:16.804 INFO:teuthology.provision.fog.smithi178:Node is ready
2023-07-13T23:22:16.804 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2023-07-13T23:22:16.829 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2023-07-13T23:22:16.830 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts
2023-07-13T23:22:16.896 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2023-07-13T23:22:16.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-07-13T23:22:17.035 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts
2023-07-13T23:22:17.067 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2023-07-13T23:22:17.138 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname
2023-07-13T23:22:17.210 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-07-13T23:22:17.278 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-07-13T23:22:17.337 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2023-07-13T23:22:17.338 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2023-07-13T23:22:17.338 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2023-07-13T23:22:17.338 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2023-07-13T23:22:17.338 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2023-07-13T23:22:17.338 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-07-13T23:22:17.338 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-13T23:22:17.339 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-07-13T23:22:17.339 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-13T23:22:17.339 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2023-07-13T23:22:17.339 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-13T23:22:17.339 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-13T23:22:17.339 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-13T23:22:17.340 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2023-07-13T23:22:17.340 DEBUG:teuthology.parallel:result is None
2023-07-13T23:22:17.497 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2023-07-13T23:22:17.498 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-13T23:22:17.525 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2023-07-13T23:22:17.526 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-13T23:22:17.553 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2023-07-13T23:22:17.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-07-13T23:22:17.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:22:17.626 DEBUG:teuthology.orchestra.run.smithi029:> true
2023-07-13T23:22:17.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-07-13T23:22:17.765 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2023-07-13T23:22:17.824 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2023-07-13T23:22:17.825 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-07-13T23:22:17.884 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2023-07-13T23:22:17.884 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-07-13T23:22:17.885 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-13T23:22:17.886 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2023-07-13T23:22:17.886 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-13T23:22:17.886 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-13T23:22:17.886 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-13T23:22:17.887 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-07-13T23:22:17.951 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2023-07-13T23:22:17.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-07-13T23:22:17.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-13T23:22:18.022 DEBUG:teuthology.orchestra.run.smithi178:> true
2023-07-13T23:22:18.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-07-13T23:22:18.094 DEBUG:teuthology.orchestra.run.smithi178:> uname -m
2023-07-13T23:22:18.154 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2023-07-13T23:22:18.155 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-07-13T23:22:18.216 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2023-07-13T23:22:18.216 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2023-07-13T23:22:18.217 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2023-07-13T23:22:18.217 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2023-07-13T23:22:18.217 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2023-07-13T23:22:18.217 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-07-13T23:22:18.217 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-13T23:22:18.217 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-07-13T23:22:18.218 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-13T23:22:18.218 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2023-07-13T23:22:18.218 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-13T23:22:18.218 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-13T23:22:18.218 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-13T23:22:18.219 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-07-13T23:22:18.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:22:18.250 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:22:18.353 INFO:teuthology.dispatcher.supervisor:Running job 7336563
2023-07-13T23:22:18.353 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563 --name gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi --description orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563/orig.config.yaml
2023-07-13T23:22:18.358 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563
2023-07-13T23:22:18.359 INFO:teuthology.dispatcher.supervisor:Job PID: 28419
2023-07-13T23:22:18.359 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-13T23:24:18.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:24:18.377 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:26:18.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:26:18.565 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:28:18.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:28:18.764 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:30:18.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:30:18.942 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:32:19.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:32:19.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:34:21.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:34:21.353 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:36:26.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:36:26.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:38:26.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-13T23:38:26.758 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-13T23:38:31.823 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-13T23:38:46.190 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-13T23:38:46.190 INFO:teuthology.nuke:Checking targets against current locks
2023-07-13T23:38:46.254 DEBUG:teuthology.nuke:shortname: smithi029
2023-07-13T23:38:46.254 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-13T23:38:46.270 DEBUG:teuthology.nuke:shortname: smithi178
2023-07-13T23:38:46.270 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-13T23:38:46.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:16:36.465510', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCf4AywsA4ISPPhbZyyayj9pGOS6qEzk+W5slFQlguquGjZYDZXdGqtl+XHdVjMkhdbDnq+g0+VZqOW1DNIkVQ7zjaco/dX5GjnVzp4M5376bADlJe94/h02/H7tA9kKeZGlGz8UtirJ9G6oq4+DUXw3JOuwid2WAHSIV3WhDRFtPGHzBPlVykwjDxkAjrCGsZ4T659sYFbQGdc9zIvVmwTYlTXNSU0gpAoqoMsryC1HQkZ4IE5SZyzUH13Va+26DR8fO+DD0qDOseb9032eiPLck8AAoVZh9WM1O+yzeTdcDLYLMAnVFNd7mumk8Dv1uoPXTf+69f0sWZ0oZ1mHeFFQgxRue1/DDabQMRL/d1ePFnslj357i2URd65uWB+vEZUtFVoyg+2/qgxSIQjNXxOX/DVRUsQ1tVdhsoWnvKQKJCRktA4Xu59UiQC092WommlJp/u86thA9KJhBNaVuoCrTiuASiOszccKzEmS3i5MyxLfWbCfxE0VBFItWDMIfU='}
2023-07-13T23:38:46.288 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-13 23:16:36.463563', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMcrd0BVdUpJKMnONlvjy8J0GdihNVI7QNfnqmgTMKBVyapdymQckrHPermmu1qB9oJxp4r5RasVJRW8eCtrTG8='}
2023-07-13T23:38:46.321 INFO:teuthology.orchestra.console:Power off smithi029
2023-07-13T23:38:46.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-13T23:38:46.337 INFO:teuthology.orchestra.console:Power off smithi178
2023-07-13T23:38:46.338 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-13T23:38:46.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:38:46.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-13T23:38:46.471 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2023-07-13T23:38:46.481 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2023-07-13T23:38:46.619 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2023-07-13T23:38:46.627 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com