2023-06-23T01:12:30.957 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-23T01:12:30.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:12:30.959 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:12:31.114 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6e05fc9670>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6e071e58b0>, signals=[15])
2023-06-23T01:12:31.116 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging
2023-06-23T01:12:31.116 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T01:12:31.116 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-06-23T01:12:31.150 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-06-23T01:12:31.151 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-06-23T01:12:31.151 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-06-23T01:12:31.152 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"}
2023-06-23T01:12:31.175 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"}
2023-06-23T01:12:31.227 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-23T01:12:31.254 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-06-23T01:12:31.272 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-23T01:12:31.272 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 7}
2023-06-23T01:12:31.294 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.4 (ID 7)
2023-06-23T01:12:31.295 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 7}
2023-06-23T01:12:31.326 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of rhel 8.4
2023-06-23T01:12:31.326 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:12:31.334 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.4
2023-06-23T01:12:31.334 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:12:31.384 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T01:12:31.397 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"}
2023-06-23T01:12:31.428 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1}
2023-06-23T01:12:31.437 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1}
2023-06-23T01:12:31.482 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:12:31.485 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:12:31.597 INFO:teuthology.orchestra.console:Power off smithi119
2023-06-23T01:12:31.598 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:12:31.614 INFO:teuthology.orchestra.console:Power off smithi092
2023-06-23T01:12:31.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:12:31.626 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:31.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:31.763 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2023-06-23T01:12:31.864 INFO:teuthology.orchestra.console:Power on smithi092
2023-06-23T01:12:31.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T01:12:31.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:35.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:35.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:36.119 INFO:teuthology.orchestra.console:Power on for smithi092 completed
2023-06-23T01:12:36.220 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2023-06-23T01:12:36.220 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:12:39.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:43.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:44.088 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2023-06-23T01:12:44.189 INFO:teuthology.orchestra.console:Power on smithi119
2023-06-23T01:12:44.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-23T01:12:44.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:48.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:51.300 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:12:52.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:12:52.558 INFO:teuthology.orchestra.console:Power on for smithi119 completed
2023-06-23T01:12:52.659 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2023-06-23T01:12:52.660 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:13:06.381 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:13:07.744 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:13:21.460 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:13:22.812 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:13:36.540 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:13:37.890 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:13:51.637 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:13:52.974 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:14:06.736 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:14:08.063 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:14:21.836 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:14:23.134 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:14:36.924 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:14:38.216 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:14:52.022 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:14:53.303 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:15:07.120 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:15:08.398 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:15:22.208 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-06-23T01:15:22.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:15:23.469 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:15:38.568 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-06-23T01:15:38.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:15:40.789 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-06-23T01:15:46.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:15:49.872 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-06-23T01:15:55.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:15:57.168 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-23T01:15:58.928 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-06-23T01:16:03.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:04.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:06.224 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-23T01:16:07.988 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-06-23T01:16:12.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:13.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:15.280 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-23T01:16:17.072 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-06-23T01:16:21.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:23.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:24.340 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-23T01:16:30.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:16:33.428 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2023-06-23T01:16:39.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:17:23.120 WARNING:teuthology.provision.fog.smithi092:timed out
2023-06-23T01:17:29.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:17:29.401 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T01:17:29.402 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T01:17:29.662 INFO:teuthology.provision.fog.smithi092:Node is ready
2023-06-23T01:17:29.662 DEBUG:teuthology.orchestra.run.smithi092:> hostname
2023-06-23T01:17:29.718 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092
2023-06-23T01:17:29.718 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092 /etc/hosts
2023-06-23T01:17:29.774 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2023-06-23T01:17:29.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-06-23T01:17:29.894 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092/smithi092/g' /etc/hosts
2023-06-23T01:17:29.921 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts
2023-06-23T01:17:29.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092/smithi092/g' /etc/hostname
2023-06-23T01:17:30.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-06-23T01:17:30.113 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-06-23T01:17:30.168 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:17:30.168 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:17:30.168 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel"
2023-06-23T01:17:30.168 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora"
2023-06-23T01:17:30.168 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:17:30.169 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:17:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:
2023-06-23T01:17:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:17:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:17:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:17:30.170 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:17:30.171 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2023-06-23T01:17:30.172 DEBUG:teuthology.parallel:result is None
2023-06-23T01:17:39.440 WARNING:teuthology.provision.fog.smithi119:timed out
2023-06-23T01:17:45.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:17:45.726 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-23T01:17:45.726 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-23T01:17:45.989 INFO:teuthology.provision.fog.smithi119:Node is ready
2023-06-23T01:17:45.990 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2023-06-23T01:17:46.044 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119
2023-06-23T01:17:46.045 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119 /etc/hosts
2023-06-23T01:17:46.099 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2023-06-23T01:17:46.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-06-23T01:17:46.203 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hosts
2023-06-23T01:17:46.228 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2023-06-23T01:17:46.291 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119/smithi119/g' /etc/hostname
2023-06-23T01:17:46.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2023-06-23T01:17:46.419 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-06-23T01:17:46.471 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:17:46.472 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:17:46.472 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-06-23T01:17:46.472 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.4"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:17:46.473 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:17:46.474 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:17:46.474 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-06-23T01:17:46.474 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:17:46.474 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:17:46.474 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:17:46.474 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:17:46.475 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2023-06-23T01:17:46.475 DEBUG:teuthology.parallel:result is None
2023-06-23T01:17:46.638 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2023-06-23T01:17:46.640 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T01:17:46.665 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2023-06-23T01:17:46.665 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-23T01:17:46.690 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2023-06-23T01:17:46.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-06-23T01:17:46.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:17:46.757 DEBUG:teuthology.orchestra.run.smithi092:> true
2023-06-23T01:17:46.880 DEBUG:teuthology.orchestra.run.smithi092:> uname -m
2023-06-23T01:17:46.936 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2023-06-23T01:17:46.936 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-06-23T01:17:46.992 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:17:46.992 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:17:46.993 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel"
2023-06-23T01:17:46.993 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora"
2023-06-23T01:17:46.993 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4"
2023-06-23T01:17:46.994 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:17:46.994 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:17:46.995 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-06-23T01:17:46.995 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:17:46.995 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:17:46.996 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:17:46.996 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:17:46.996 INFO:teuthology.orchestra.run.smithi092.stdout:
2023-06-23T01:17:46.996 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:17:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:17:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:17:46.997 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:17:46.998 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-06-23T01:17:47.022 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2023-06-23T01:17:47.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2023-06-23T01:17:47.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-23T01:17:47.086 DEBUG:teuthology.orchestra.run.smithi119:> true
2023-06-23T01:17:47.155 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2023-06-23T01:17:47.208 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2023-06-23T01:17:47.208 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2023-06-23T01:17:47.262 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2023-06-23T01:17:47.263 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.4 (Ootpa)"
2023-06-23T01:17:47.263 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2023-06-23T01:17:47.263 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2023-06-23T01:17:47.263 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.4"
2023-06-23T01:17:47.263 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2023-06-23T01:17:47.264 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-23T01:17:47.264 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2023-06-23T01:17:47.264 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-23T01:17:47.264 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2023-06-23T01:17:47.264 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-23T01:17:47.264 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-23T01:17:47.265 INFO:teuthology.orchestra.run.smithi119.stdout:
2023-06-23T01:17:47.265 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-23T01:17:47.265 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-23T01:17:47.265 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-23T01:17:47.265 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-23T01:17:47.266 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-06-23T01:17:47.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:17:47.356 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:17:47.464 INFO:teuthology.dispatcher.supervisor:Running job 7311967
2023-06-23T01:17:47.465 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311967 --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311967/orig.config.yaml
2023-06-23T01:17:47.468 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311967
2023-06-23T01:17:47.469 INFO:teuthology.dispatcher.supervisor:Job PID: 9700
2023-06-23T01:17:47.470 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-23T01:19:47.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:19:47.570 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:21:47.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:21:47.746 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:23:47.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:23:47.926 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:25:48.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:25:48.103 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:27:48.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:27:48.276 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:29:48.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:29:48.449 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:31:48.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:31:48.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:33:48.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-23T01:33:48.834 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-23T01:33:48.907 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-23T01:33:49.045 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-23T01:33:49.046 INFO:teuthology.nuke:Checking targets against current locks
2023-06-23T01:33:49.096 DEBUG:teuthology.nuke:shortname: smithi092
2023-06-23T01:33:49.096 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T01:33:49.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311967', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 01:12:30.125762', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyCtGo6+Kvz2SWXvHcKq7TwgALZE7O2ZdSSDCKapdOYVDM/+QueBF/SOjjHzoK5xE3qRycvt4MeThoeNOlqGjBDuBnQ1xGPKdvQk852T9BVxz4/2FXr4bBQkf3meLqHxBufyzi07l7SA2ix1Vt6cZKib1QD9uAQL2chWtiTBItmBT16F2fP5qTm46PP+qRVTce+SWbH6QzOXCXiW8Td4zJurxt7VUlWBOVGh8dndG5QnoBLSndUMyiRI+dz34yhUPtRiWXhpDFQXO0Fx3psirsHTyRLczUunFKD3/TpRhcztV4LefNT22EheSHzUazFylz0kl0G9kf4KerisAgZPlJnV9288oXEQDZsgJ3MdZYX9YYcH66DFaveR2jfFYXTBlZ88DEVlQX8o+ThLVFc+K/UwNVlkzBNfsXrkLt+2fYXSgOem9cEuVRue/aG1b4e6Z/Gs2c4UQrwPTk3qA1M8RgQaWMDxq8xtrzs3upVTXBbHJrdjGjbZuVj+/jOeXVyZ8='}
2023-06-23T01:33:49.124 DEBUG:teuthology.nuke:shortname: smithi119
2023-06-23T01:33:49.124 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-23T01:33:49.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311967', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 01:12:30.127509', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbatMXeLcMLuQDmdjxHrNuwug4CM7BnUzrhJ0MzSXJQPq5T+21eDfm3gFGTmd8j1sLTQGFLEZdVxC5LMsbJg4z5BLpBBtuwaFKNxM54ePZPOFwXTQx8uUC8aY/xJEecFwDcaIYjlzuQF7zedT+8ZQLWWoUOKmyOqq/VHZIyU0LXNy1yWR3ZSX0Y+L0AjXXlRB85AwxoXlR0mIwXmeT39ozkK/jqz+FDtlnh6mVAf9zpsdl8jKXcMRFKU8uAE4ByOfSiQFkkKIt5FXkGFkc55IvLuodTRi7eB/h08ZeL+ApFKjeOP9WZjNB+mMfLHKBwTBoNl3hYaQZWGPAShxgfeG0tqysLYKVcRfAleAvafOpSWBoaf7JLuhAcZDv1eshFfC98fkIJFlahh0xmzyzwFKXk3zlwmzn+EmOhpUCiYIsksb+6gSz78RsQjAZMFrZukMct8DTaJwqh+gujOG1LEvh4r1jiIvQGokgwAQ9DYQ5ULPE2MqdkpEe9hW7x7npks0='}
2023-06-23T01:33:49.184 INFO:teuthology.orchestra.console:Power off smithi092
2023-06-23T01:33:49.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:33:49.202 INFO:teuthology.orchestra.console:Power off smithi119
2023-06-23T01:33:49.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-23T01:33:49.213 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:33:49.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-23T01:33:49.339 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2023-06-23T01:33:49.348 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2023-06-23T01:33:49.497 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2023-06-23T01:33:49.506 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com