2023-07-20T08:25:33.905 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-20T08:25:33.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T08:25:33.907 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T08:25:34.063 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2a92be85e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2a92c51f70>, signals=[15])
2023-07-20T08:25:34.064 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2023-07-20T08:25:34.065 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T08:25:34.065 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-07-20T08:25:34.084 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-07-20T08:25:34.084 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-07-20T08:25:34.085 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-07-20T08:25:34.086 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"}
2023-07-20T08:25:34.109 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /host {"name": "smithi196"}
2023-07-20T08:25:34.160 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-20T08:25:34.176 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-20T08:25:34.201 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10)
2023-07-20T08:25:34.201 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10}
2023-07-20T08:25:34.216 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_9.stream (ID 10)
2023-07-20T08:25:34.216 DEBUG:teuthology.provision.fog.smithi196:FOG request: PUT /host/301 {"imageID": 10}
2023-07-20T08:25:34.244 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream
2023-07-20T08:25:34.245 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:25:34.256 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 9.stream
2023-07-20T08:25:34.257 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:25:34.306 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T08:25:34.309 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"}
2023-07-20T08:25:34.341 DEBUG:teuthology.provision.fog.smithi196:FOG request: POST /host/301/task {"taskTypeID": 1}
2023-07-20T08:25:34.342 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1}
2023-07-20T08:25:34.389 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:25:34.395 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:25:34.485 INFO:teuthology.orchestra.console:Power off smithi003
2023-07-20T08:25:34.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T08:25:34.501 INFO:teuthology.orchestra.console:Power off smithi196
2023-07-20T08:25:34.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T08:25:34.511 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:34.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:34.634 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-07-20T08:25:34.646 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-07-20T08:25:34.736 INFO:teuthology.orchestra.console:Power on smithi003
2023-07-20T08:25:34.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T08:25:34.747 INFO:teuthology.orchestra.console:Power on smithi196
2023-07-20T08:25:34.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-20T08:25:34.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:34.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:38.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:38.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:42.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:42.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:25:43.108 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2023-07-20T08:25:43.116 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2023-07-20T08:25:43.209 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2023-07-20T08:25:43.210 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:25:43.217 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-07-20T08:25:43.217 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:25:58.368 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:25:58.369 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:26:13.556 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:26:13.557 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:26:28.720 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:26:28.724 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:26:43.890 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:26:43.897 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:26:59.062 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:26:59.063 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:27:14.224 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:27:14.225 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:27:29.408 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:27:29.425 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:27:44.659 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:27:44.660 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:27:59.860 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:27:59.861 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:28:15.091 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-20T08:28:15.092 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:28:15.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:28:18.384 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T08:28:24.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:28:27.440 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T08:28:30.302 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:28:33.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:28:36.496 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T08:28:42.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:28:45.531 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:28:45.552 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T08:28:51.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:28:54.608 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T08:29:00.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:29:00.729 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:29:03.700 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-20T08:29:09.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:29:15.945 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:29:31.173 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:29:46.480 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:30:01.696 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:30:09.712 WARNING:teuthology.provision.fog.smithi003:timed out
2023-07-20T08:30:15.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:30:15.963 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T08:30:15.964 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T08:30:16.290 INFO:teuthology.provision.fog.smithi003:Node is ready
2023-07-20T08:30:16.291 DEBUG:teuthology.orchestra.run.smithi003:> hostname
2023-07-20T08:30:16.306 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com
2023-07-20T08:30:16.306 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts
2023-07-20T08:30:16.361 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003
2023-07-20T08:30:16.362 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003
2023-07-20T08:30:16.499 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts
2023-07-20T08:30:16.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts
2023-07-20T08:30:16.605 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname
2023-07-20T08:30:16.678 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003
2023-07-20T08:30:16.752 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release
2023-07-20T08:30:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2023-07-20T08:30:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9"
2023-07-20T08:30:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2023-07-20T08:30:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2023-07-20T08:30:16.810 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2023-07-20T08:30:16.811 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T08:30:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-20T08:30:16.812 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-20T08:30:16.812 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2023-07-20T08:30:16.814 DEBUG:teuthology.parallel:result is None
2023-07-20T08:30:16.880 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:30:32.084 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:30:47.265 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:31:02.439 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:31:17.621 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-07-20T08:31:17.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:31:20.817 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:31:26.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:31:29.872 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:31:35.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:31:38.928 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:31:44.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:31:47.988 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:31:53.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:31:57.072 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:32:03.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:32:06.132 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:32:12.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:32:15.216 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-07-20T08:32:21.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:33:21.264 WARNING:teuthology.provision.fog.smithi196:timed out
2023-07-20T08:33:27.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:33:27.481 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-20T08:33:27.482 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-20T08:33:27.814 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-07-20T08:33:27.815 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-07-20T08:33:27.829 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2023-07-20T08:33:27.829 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2023-07-20T08:33:27.883 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-07-20T08:33:27.884 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-07-20T08:33:28.018 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2023-07-20T08:33:28.046 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-07-20T08:33:28.112 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2023-07-20T08:33:28.179 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-07-20T08:33:28.245 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-07-20T08:33:28.300 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-07-20T08:33:28.300 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2023-07-20T08:33:28.300 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-07-20T08:33:28.300 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-07-20T08:33:28.300 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2023-07-20T08:33:28.300 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-20T08:33:28.301 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-20T08:33:28.302 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-07-20T08:33:28.302 DEBUG:teuthology.parallel:result is None
2023-07-20T08:33:28.486 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2023-07-20T08:33:28.487 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T08:33:28.516 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-07-20T08:33:28.516 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-20T08:33:28.542 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2023-07-20T08:33:28.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-20T08:33:28.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:33:28.640 DEBUG:teuthology.orchestra.run.smithi003:> true
2023-07-20T08:33:28.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-20T08:33:28.823 DEBUG:teuthology.orchestra.run.smithi003:> uname -m
2023-07-20T08:33:28.877 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2023-07-20T08:33:28.878 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9"
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9"
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9"
2023-07-20T08:33:28.933 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-20T08:33:28.934 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-20T08:33:28.935 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-07-20T08:33:28.957 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-07-20T08:33:28.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-07-20T08:33:28.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-20T08:33:29.037 DEBUG:teuthology.orchestra.run.smithi196:> true
2023-07-20T08:33:29.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-07-20T08:33:29.060 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2023-07-20T08:33:29.113 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-07-20T08:33:29.114 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-07-20T08:33:29.168 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-07-20T08:33:29.168 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9"
2023-07-20T08:33:29.168 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-07-20T08:33:29.168 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-07-20T08:33:29.168 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-20T08:33:29.169 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-20T08:33:29.170 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-20T08:33:29.170 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-07-20T08:33:29.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T08:33:29.191 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T08:33:29.299 INFO:teuthology.dispatcher.supervisor:Running job 7344462
2023-07-20T08:33:29.299 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344462 --name vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344462/orig.config.yaml
2023-07-20T08:33:29.302 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344462
2023-07-20T08:33:29.303 INFO:teuthology.dispatcher.supervisor:Job PID: 24601
2023-07-20T08:33:29.303 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-20T08:35:29.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-20T08:35:29.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-20T08:35:29.468 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-20T08:35:29.582 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-20T08:35:29.583 INFO:teuthology.nuke:Checking targets against current locks
2023-07-20T08:35:29.639 DEBUG:teuthology.nuke:shortname: smithi003
2023-07-20T08:35:29.639 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T08:35:29.660 DEBUG:teuthology.nuke:shortname: smithi196
2023-07-20T08:35:29.660 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-20T08:35:29.663 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344462', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 08:25:33.026034', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNWcgJf0kYDYn4XM7hxwpVtxOcMc3lg00kIXa69yVGhy1NE3HAo/ToaaDq+K7JFQbafsgi6CrtcEPfrah0ohSJc='}
2023-07-20T08:35:29.688 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-20_08:24:15-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7344462', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 08:25:33.027529', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIHjgWOiol70XVn3mnlOwKNZL14VvWbEAp4jYWLdutIapeJqZAznaIHS6TR0xXP1/qHq2D7orVGco+9OOzWdX2w='}
2023-07-20T08:35:29.721 INFO:teuthology.orchestra.console:Power off smithi003
2023-07-20T08:35:29.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T08:35:29.742 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:35:29.759 INFO:teuthology.orchestra.console:Power off smithi196
2023-07-20T08:35:29.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-20T08:35:29.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-20T08:35:29.868 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-07-20T08:35:29.925 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-07-20T08:35:30.025 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2023-07-20T08:35:30.077 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com