2023-07-24T05:04:10.741 INFO:root:teuthology version: 0.0.1.dev158+g1426592
2023-07-24T05:04:10.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-24T05:04:10.743 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-24T05:04:10.890 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8b1289fe50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8b1293c280>, signals=[15])
2023-07-24T05:04:10.891 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2023-07-24T05:04:10.892 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2023-07-24T05:04:10.892 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-07-24T05:04:10.910 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-07-24T05:04:10.911 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-07-24T05:04:10.911 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-07-24T05:04:10.912 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /host {"name": "smithi029"}
2023-07-24T05:04:10.935 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"}
2023-07-24T05:04:10.979 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-24T05:04:11.002 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-24T05:04:11.023 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10)
2023-07-24T05:04:11.024 DEBUG:teuthology.provision.fog.smithi029:FOG request: PUT /host/134 {"imageID": 10}
2023-07-24T05:04:11.045 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10)
2023-07-24T05:04:11.045 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 10}
2023-07-24T05:04:11.074 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream
2023-07-24T05:04:11.075 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:04:11.098 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream
2023-07-24T05:04:11.098 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:04:11.297 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /tasktype {"name": "deploy"}
2023-07-24T05:04:11.319 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"}
2023-07-24T05:04:11.333 DEBUG:teuthology.provision.fog.smithi029:FOG request: POST /host/134/task {"taskTypeID": 1}
2023-07-24T05:04:11.363 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1}
2023-07-24T05:04:11.390 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:04:11.414 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:04:11.679 INFO:teuthology.orchestra.console:Power off smithi029
2023-07-24T05:04:11.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-24T05:04:11.694 INFO:teuthology.orchestra.console:Power off smithi136
2023-07-24T05:04:11.695 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-24T05:04:11.704 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-24T05:04:11.705 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:11.716 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-24T05:04:11.717 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:11.727 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:11.740 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:15.732 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:15.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:15.842 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:15.850 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:19.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:19.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:19.959 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:04:19.965 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:20.060 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2023-07-24T05:04:20.161 INFO:teuthology.orchestra.console:Power on smithi029
2023-07-24T05:04:20.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-24T05:04:20.181 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-24T05:04:20.182 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:20.201 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:04:23.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:24.079 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:04:24.180 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2023-07-24T05:04:24.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:24.281 INFO:teuthology.orchestra.console:Power on smithi136
2023-07-24T05:04:24.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-24T05:04:24.300 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-24T05:04:24.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:24.312 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:04:24.319 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:04:28.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:28.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:28.435 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:04:28.440 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:28.540 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2023-07-24T05:04:28.641 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2023-07-24T05:04:28.641 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:04:32.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:04:32.549 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-24T05:04:32.649 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2023-07-24T05:04:32.750 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-07-24T05:04:32.750 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:04:43.900 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:04:48.028 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:04:59.257 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:05:03.294 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:05:14.537 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:05:18.529 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:05:29.793 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:05:33.815 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:05:45.157 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:05:49.168 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:06:00.495 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:06:04.521 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:06:23.643 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:06:26.430 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:06:41.094 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:06:45.354 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:06:59.746 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:07:03.128 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:07:16.603 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:07:19.964 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:07:34.144 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:07:36.831 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:07:51.792 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:07:54.096 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:08:08.048 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:08:11.188 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:08:24.552 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:08:27.789 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:08:41.750 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:08:44.810 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:08:57.929 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:09:01.128 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:09:14.048 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:09:17.379 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-07-24T05:09:18.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:09:21.808 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:09:27.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:09:30.152 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:09:30.864 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:09:36.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:09:39.920 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:09:45.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:09:46.231 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:09:48.976 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:09:54.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:09:58.064 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:10:02.154 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:10:04.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:10:07.120 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:10:13.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:10:17.596 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:10:19.252 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:10:25.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:10:28.336 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:10:32.906 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:10:34.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:10:37.392 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-07-24T05:10:43.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:10:44.576 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-24T05:10:44.577 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-24T05:10:48.241 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:11:03.470 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:11:10.011 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-07-24T05:11:10.011 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2023-07-24T05:11:10.029 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2023-07-24T05:11:10.030 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2023-07-24T05:11:10.086 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2023-07-24T05:11:10.087 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-07-24T05:11:10.219 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2023-07-24T05:11:10.250 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2023-07-24T05:11:10.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2023-07-24T05:11:10.388 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-07-24T05:11:10.456 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-07-24T05:11:10.510 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2023-07-24T05:11:10.511 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2023-07-24T05:11:10.511 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2023-07-24T05:11:10.511 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2023-07-24T05:11:10.511 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2023-07-24T05:11:10.511 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2023-07-24T05:11:10.511 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-24T05:11:10.512 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-24T05:11:10.513 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-07-24T05:11:10.514 DEBUG:teuthology.parallel:result is None
2023-07-24T05:11:19.072 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:11:34.470 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:11:49.821 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:12:05.244 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:12:20.688 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:12:35.984 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:12:51.328 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:13:06.628 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:13:21.904 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:13:37.186 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:13:52.580 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:14:07.860 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:14:23.144 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:14:38.392 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:14:53.612 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:15:08.856 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:15:24.060 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:15:39.248 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:15:54.428 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:16:09.592 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:16:24.763 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:16:39.926 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:16:55.078 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:17:10.224 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:17:25.404 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:17:40.560 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:17:55.692 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:18:10.844 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:18:25.975 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:18:41.112 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:18:56.228 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:19:11.358 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:19:26.461 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:19:41.556 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:19:56.648 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:20:11.748 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:20:26.840 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:20:41.924 DEBUG:teuthology.provision.fog.smithi029:FOG request: GET /task/active None
2023-07-24T05:20:41.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:20:45.040 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-24T05:20:51.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:20:54.100 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-24T05:21:00.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:21:03.188 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-24T05:21:09.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:21:12.272 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-24T05:21:18.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:21:21.328 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-07-24T05:21:27.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:22:27.392 WARNING:teuthology.provision.fog.smithi029:timed out
2023-07-24T05:22:33.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:22:33.670 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-24T05:22:33.670 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-24T05:22:34.063 INFO:teuthology.provision.fog.smithi029:Node is ready
2023-07-24T05:22:34.064 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2023-07-24T05:22:34.079 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2023-07-24T05:22:34.079 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2023-07-24T05:22:34.134 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2023-07-24T05:22:34.135 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-07-24T05:22:34.256 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2023-07-24T05:22:34.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2023-07-24T05:22:34.360 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2023-07-24T05:22:34.431 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-07-24T05:22:34.502 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-07-24T05:22:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2023-07-24T05:22:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9"
2023-07-24T05:22:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2023-07-24T05:22:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2023-07-24T05:22:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2023-07-24T05:22:34.558 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-24T05:22:34.559 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-24T05:22:34.559 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-24T05:22:34.559 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2023-07-24T05:22:34.560 DEBUG:teuthology.parallel:result is None
2023-07-24T05:22:34.720 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2023-07-24T05:22:34.721 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-24T05:22:34.747 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2023-07-24T05:22:34.747 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-24T05:22:34.774 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2023-07-24T05:22:34.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-07-24T05:22:34.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:22:34.873 DEBUG:teuthology.orchestra.run.smithi029:> true
2023-07-24T05:22:34.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-07-24T05:22:34.944 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2023-07-24T05:22:34.999 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2023-07-24T05:22:35.000 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-07-24T05:22:35.054 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2023-07-24T05:22:35.055 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9"
2023-07-24T05:22:35.055 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2023-07-24T05:22:35.055 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2023-07-24T05:22:35.055 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9"
2023-07-24T05:22:35.055 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-24T05:22:35.056 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-24T05:22:35.057 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-24T05:22:35.057 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-07-24T05:22:35.080 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2023-07-24T05:22:35.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-07-24T05:22:35.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-24T05:22:35.162 DEBUG:teuthology.orchestra.run.smithi136:> true
2023-07-24T05:22:35.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-07-24T05:22:35.339 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2023-07-24T05:22:35.393 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2023-07-24T05:22:35.393 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-07-24T05:22:35.447 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2023-07-24T05:22:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9"
2023-07-24T05:22:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2023-07-24T05:22:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2023-07-24T05:22:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9"
2023-07-24T05:22:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9"
2023-07-24T05:22:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-24T05:22:35.449 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-07-24T05:22:35.449 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon"
2023-07-24T05:22:35.449 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-24T05:22:35.449 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2023-07-24T05:22:35.449 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-24T05:22:35.449 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-24T05:22:35.450 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-24T05:22:35.450 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-07-24T05:22:35.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-24T05:22:35.473 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-24T05:22:35.568 INFO:teuthology.dispatcher.supervisor:Running job 7349256
2023-07-24T05:22:35.568 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_1426592083662fef3e03bbeec33624331f0fdbc1/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349256 --name vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} -- /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349256/orig.config.yaml
2023-07-24T05:22:35.572 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349256
2023-07-24T05:22:35.573 INFO:teuthology.dispatcher.supervisor:Job PID: 28140
2023-07-24T05:22:35.573 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-24T05:24:35.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-24T05:24:35.673 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-24T05:24:35.744 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-24T05:24:35.853 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-24T05:24:35.853 INFO:teuthology.nuke:Checking targets against current locks
2023-07-24T05:24:35.899 DEBUG:teuthology.nuke:shortname: smithi029
2023-07-24T05:24:35.899 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-24T05:24:35.920 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:09.938514', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJT9QC+r4eUIefvzpEegrwd0xIeogKSBprnjqmhNNhJi59vhzmOV8OMnBOtiLT8ZdWAngO0d+PUtO+D0Mgi8gAM='}
2023-07-24T05:24:35.923 DEBUG:teuthology.nuke:shortname: smithi136
2023-07-24T05:24:35.924 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-24T05:24:35.943 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349256', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:09.939941', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZrSJi++CMn9TPKxm+PH54TzCcCCv/VLUsilh5fIxuhIvIDWtV9AqYJxJNjuNijg0sRx0IoyAPU4OUJB6NSqGs='}
2023-07-24T05:24:35.968 INFO:teuthology.orchestra.console:Power off smithi029
2023-07-24T05:24:35.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-24T05:24:35.991 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-24T05:24:35.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:24:36.008 INFO:teuthology.orchestra.console:Power off smithi136
2023-07-24T05:24:36.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-24T05:24:36.019 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:24:36.031 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-24T05:24:36.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-24T05:24:36.053 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-24T05:24:36.121 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2023-07-24T05:24:36.155 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2023-07-24T05:24:36.267 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2023-07-24T05:24:36.301 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com