2023-06-23T00:59:11.561 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-23T00:59:11.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T00:59:11.563 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T00:59:11.733 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fcd332e96d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fcd345078b0>, signals=[15])
2023-06-23T00:59:11.735 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2023-06-23T00:59:11.735 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T00:59:11.736 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-06-23T00:59:11.764 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging
2023-06-23T00:59:11.765 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T00:59:11.765 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2023-06-23T00:59:11.767 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"}
2023-06-23T00:59:11.797 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /host {"name": "smithi193"}
2023-06-23T00:59:11.841 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-23T00:59:11.878 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-23T00:59:11.883 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-23T00:59:11.884 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 7}
2023-06-23T00:59:11.919 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-23T00:59:11.920 DEBUG:teuthology.provision.fog.smithi193:FOG request: PUT /host/298 {"imageID": 7}
2023-06-23T00:59:11.941 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.4
2023-06-23T00:59:11.941 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T00:59:11.966 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.4
2023-06-23T00:59:11.966 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T00:59:12.008 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T00:59:12.021 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T00:59:12.043 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1}
2023-06-23T00:59:12.053 DEBUG:teuthology.provision.fog.smithi193:FOG request: POST /host/298/task {"taskTypeID": 1}
2023-06-23T00:59:12.097 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T00:59:12.116 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T00:59:12.210 INFO:teuthology.orchestra.console:Power off smithi193
2023-06-23T00:59:12.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T00:59:12.228 INFO:teuthology.orchestra.console:Power off smithi067
2023-06-23T00:59:12.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T00:59:12.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:12.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:12.364 INFO:teuthology.orchestra.console:Power off for smithi193 completed
2023-06-23T00:59:12.376 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-06-23T00:59:12.466 INFO:teuthology.orchestra.console:Power on smithi193
2023-06-23T00:59:12.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T00:59:12.478 INFO:teuthology.orchestra.console:Power on smithi067
2023-06-23T00:59:12.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T00:59:12.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:12.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:16.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:16.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:16.743 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2023-06-23T00:59:16.844 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2023-06-23T00:59:16.845 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T00:59:20.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T00:59:20.848 INFO:teuthology.orchestra.console:Power on for smithi193 completed
2023-06-23T00:59:20.949 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish
2023-06-23T00:59:20.950 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T00:59:31.934 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T00:59:36.028 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T00:59:47.020 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T00:59:51.112 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:00:02.100 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:00:06.169 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:00:17.164 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:00:21.228 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:00:32.244 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:00:36.300 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:00:47.376 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:00:51.368 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:01:02.452 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:01:06.432 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:01:17.524 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:01:21.502 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:01:32.594 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:01:36.560 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:01:47.660 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:01:51.616 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:02:02.726 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-06-23T01:02:02.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:06.684 DEBUG:teuthology.provision.fog.smithi193:FOG request: GET /task/active None
2023-06-23T01:02:06.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:21.296 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T01:02:25.136 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-23T01:02:27.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:30.352 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T01:02:31.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:34.192 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-23T01:02:36.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:39.408 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T01:02:40.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:43.248 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-23T01:02:45.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:48.464 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T01:02:49.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:52.304 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-06-23T01:02:54.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:02:57.520 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T01:02:58.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:03:03.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:03:06.576 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-06-23T01:03:12.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:03:58.352 WARNING:teuthology.provision.fog.smithi193:timed out
2023-06-23T01:04:04.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:04:04.639 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T01:04:04.640 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T01:04:04.901 INFO:teuthology.provision.fog.smithi193:Node is ready
2023-06-23T01:04:04.901 DEBUG:teuthology.orchestra.run.smithi193:> hostname
2023-06-23T01:04:04.958 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com
2023-06-23T01:04:04.959 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts
2023-06-23T01:04:05.014 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2023-06-23T01:04:05.014 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2023-06-23T01:04:05.125 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts
2023-06-23T01:04:05.151 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts
2023-06-23T01:04:05.216 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname
2023-06-23T01:04:05.280 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2023-06-23T01:04:05.343 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2023-06-23T01:04:05.398 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:04:05.398 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:04:05.398 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel"
2023-06-23T01:04:05.398 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.4"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:04:05.399 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:04:05.400 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:04:05.400 INFO:teuthology.orchestra.run.smithi193.stdout:
2023-06-23T01:04:05.400 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:04:05.400 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:04:05.400 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:04:05.400 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:04:05.401 INFO:teuthology.provision.fog.smithi193:Deploy complete!
2023-06-23T01:04:05.402 DEBUG:teuthology.parallel:result is None
2023-06-23T01:04:12.588 WARNING:teuthology.provision.fog.smithi067:timed out
2023-06-23T01:04:18.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:04:18.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T01:04:18.931 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T01:04:19.211 INFO:teuthology.provision.fog.smithi067:Node is ready
2023-06-23T01:04:19.212 DEBUG:teuthology.orchestra.run.smithi067:> hostname
2023-06-23T01:04:19.228 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2023-06-23T01:04:19.228 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts
2023-06-23T01:04:19.284 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2023-06-23T01:04:19.284 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-06-23T01:04:19.404 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts
2023-06-23T01:04:19.430 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts
2023-06-23T01:04:19.497 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname
2023-06-23T01:04:19.562 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-06-23T01:04:19.626 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-06-23T01:04:19.680 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:04:19.680 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:04:19.680 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel"
2023-06-23T01:04:19.681 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora"
2023-06-23T01:04:19.681 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4"
2023-06-23T01:04:19.681 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:04:19.681 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:
2023-06-23T01:04:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:04:19.683 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:04:19.683 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:04:19.683 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:04:19.683 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2023-06-23T01:04:19.684 DEBUG:teuthology.parallel:result is None
2023-06-23T01:04:19.842 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2023-06-23T01:04:19.842 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T01:04:19.872 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com
2023-06-23T01:04:19.872 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T01:04:19.890 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2023-06-23T01:04:19.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2023-06-23T01:04:19.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:04:19.955 DEBUG:teuthology.orchestra.run.smithi067:> true
2023-06-23T01:04:20.019 DEBUG:teuthology.orchestra.run.smithi067:> uname -m
2023-06-23T01:04:20.075 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2023-06-23T01:04:20.075 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-06-23T01:04:20.130 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:04:20.131 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:04:20.131 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel"
2023-06-23T01:04:20.131 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora"
2023-06-23T01:04:20.132 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.4"
2023-06-23T01:04:20.132 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:04:20.132 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:04:20.132 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-06-23T01:04:20.133 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:04:20.133 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:04:20.133 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:04:20.134 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:04:20.134 INFO:teuthology.orchestra.run.smithi067.stdout:
2023-06-23T01:04:20.134 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:04:20.135 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:04:20.135 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:04:20.135 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:04:20.136 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-06-23T01:04:20.164 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server
2023-06-23T01:04:20.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com'
2023-06-23T01:04:20.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:04:20.232 DEBUG:teuthology.orchestra.run.smithi193:> true
2023-06-23T01:04:20.350 DEBUG:teuthology.orchestra.run.smithi193:> uname -m
2023-06-23T01:04:20.404 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64
2023-06-23T01:04:20.405 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2023-06-23T01:04:20.460 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:04:20.461 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:04:20.461 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel"
2023-06-23T01:04:20.461 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora"
2023-06-23T01:04:20.461 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.4"
2023-06-23T01:04:20.462 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:04:20.462 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:04:20.462 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2023-06-23T01:04:20.462 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:04:20.462 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:04:20.463 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:04:20.463 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:04:20.464 INFO:teuthology.orchestra.run.smithi193.stdout:
2023-06-23T01:04:20.464 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:04:20.464 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:04:20.464 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:04:20.465 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:04:20.465 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2023-06-23T01:04:20.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:04:20.489 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:04:20.589 INFO:teuthology.dispatcher.supervisor:Running job 7311945
2023-06-23T01:04:20.589 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311945 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311945/orig.config.yaml
2023-06-23T01:04:20.593 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311945
2023-06-23T01:04:20.593 INFO:teuthology.dispatcher.supervisor:Job PID: 9007
2023-06-23T01:04:20.594 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-23T01:06:20.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:06:20.695 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:08:20.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:08:20.865 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:10:21.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:10:21.033 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:12:21.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:12:21.207 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:14:21.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:14:21.382 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:16:21.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:16:21.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:18:21.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:18:21.714 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:20:21.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:20:21.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:22:22.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:22:22.065 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:24:22.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:24:22.240 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:26:22.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:26:22.406 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:26:22.471 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-23T01:26:22.586 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-23T01:26:22.586 INFO:teuthology.nuke:Checking targets against current locks
2023-06-23T01:26:22.639 DEBUG:teuthology.nuke:shortname: smithi067
2023-06-23T01:26:22.640 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T01:26:22.661 DEBUG:teuthology.nuke:shortname: smithi193
2023-06-23T01:26:22.662 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T01:26:22.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:59:10.563533', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSI9ftZPlRt+IDHUi5hLfCxz7QLJGWQzw8RXkHRFcGsdhLvRaI9dDGsCupQX8AnPEPQNjqvtNkeAzBBPaJrU6mukCrWlcP5De7lGHelE7UA8J1IvH79bsdvgSWpjp3ed5NZVF6A0urzpmxol78o4MUZMibWHiHB+cHw+i18aYXMwKI5H6NkeiqGmD8y0PH5B8rM6vYJg5jVctgUIg/mM+1GV2ZsRKuIQmdiE+6VmHN8aTg4PLF/DWBX2fB2O4j867QZnZUyKaboSKtJgCf8V7FOvYSlewnDvr+yDEwVeXfLxgHR6dLxn+Vl/erM1IIFyqtjJHXASH0J1rOCqENj2g+N5fHaMGGmyTBtjza0h5lVBUSrxkg7BwqzR6xuo/3yoj88cDBrvdcq6f8w6SNcngV35J0dh1x8vERPrjjSn+p10IKVMKkDreofHWSNGsA9CxskVD2dB+40gSsGzQs/ngcwtihMwarIdnHHSAgve3Xt9+vSqrroi44BLzgpooNQss='}
2023-06-23T01:26:22.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 00:59:10.565178', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBED64u4gjLzpTDT6XA3p9m/odRaKWL8FincvF3djpWK1PElxZKPfNAr+gOw0bHvTOWBCdhDdQlZfrX7eCSWhduQ='}
2023-06-23T01:26:22.718 INFO:teuthology.orchestra.console:Power off smithi067
2023-06-23T01:26:22.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:26:22.736 INFO:teuthology.orchestra.console:Power off smithi193
2023-06-23T01:26:22.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:26:22.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:26:22.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:26:22.869 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-06-23T01:26:22.881 INFO:teuthology.orchestra.console:Power off for smithi193 completed
2023-06-23T01:26:23.027 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2023-06-23T01:26:23.038 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com