2023-07-24T05:04:08.551 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-24T05:04:08.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:04:08.553 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:04:08.724 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a4abcd1f0>, signals=[15]) 2023-07-24T05:04:08.726 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-07-24T05:04:08.726 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:08.726 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-07-24T05:04:08.751 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-07-24T05:04:08.751 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:08.751 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-24T05:04:08.753 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /host {"name": "smithi039"} 2023-07-24T05:04:08.775 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-07-24T05:04:08.775 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:08.776 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-24T05:04:08.777 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-07-24T05:04:08.802 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-07-24T05:04:08.828 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-24T05:04:08.836 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-24T05:04:08.868 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-24T05:04:08.871 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2023-07-24T05:04:08.871 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 10} 2023-07-24T05:04:08.873 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10) 2023-07-24T05:04:08.873 DEBUG:teuthology.provision.fog.smithi039:FOG request: PUT /host/144 {"imageID": 10} 2023-07-24T05:04:08.913 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_9.stream (ID 10) 2023-07-24T05:04:08.913 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 10} 2023-07-24T05:04:08.920 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream 2023-07-24T05:04:08.921 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:04:08.923 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2023-07-24T05:04:08.923 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:04:08.971 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 9.stream 2023-07-24T05:04:08.971 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:04:09.122 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:09.128 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:09.139 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:09.162 DEBUG:teuthology.provision.fog.smithi039:FOG request: POST /host/144/task {"taskTypeID": 1} 2023-07-24T05:04:09.167 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-07-24T05:04:09.179 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-07-24T05:04:09.216 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:04:09.219 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:04:09.232 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:04:09.479 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-24T05:04:09.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:09.497 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-24T05:04:09.498 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:09.512 INFO:teuthology.orchestra.console:Power off smithi039 2023-07-24T05:04:09.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:09.522 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:09.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:09.531 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:09.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:09.542 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:09.543 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:09.553 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:09.554 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:09.565 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:13.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:13.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:13.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:13.666 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:13.674 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:13.683 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:17.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.778 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:17.786 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:17.795 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:17.879 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-24T05:04:17.887 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-24T05:04:17.981 INFO:teuthology.orchestra.console:Power on smithi045 2023-07-24T05:04:17.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:17.989 INFO:teuthology.orchestra.console:Power on smithi040 2023-07-24T05:04:17.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:18.001 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:18.002 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:18.010 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:18.011 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:18.021 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:18.030 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:21.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:21.909 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:22.010 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-07-24T05:04:22.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:22.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:22.112 INFO:teuthology.orchestra.console:Power on smithi039 2023-07-24T05:04:22.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:22.131 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:22.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:22.139 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:22.142 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:22.152 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:26.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:26.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:26.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:26.254 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:26.260 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:26.266 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:26.356 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2023-07-24T05:04:26.361 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2023-07-24T05:04:26.367 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2023-07-24T05:04:26.457 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-07-24T05:04:26.457 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:04:26.462 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-07-24T05:04:26.462 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:04:26.468 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-07-24T05:04:26.469 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:04:41.707 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:04:41.709 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:04:41.741 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:04:56.966 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:04:56.967 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:04:56.981 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:05:12.214 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:05:12.219 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:05:12.230 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:05:27.468 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:05:27.476 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:05:27.516 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:05:42.766 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:05:42.779 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:05:42.807 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:05:58.099 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:05:58.100 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:05:58.146 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:06:21.422 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:06:21.905 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:06:21.916 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:06:38.528 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:06:39.018 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:06:39.175 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:06:55.892 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:06:57.008 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:06:57.150 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:07:11.309 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:07:13.085 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:07:13.517 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:07:27.872 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:07:28.914 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:07:29.167 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:07:47.472 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:07:47.721 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:07:47.776 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:08:04.536 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:08:04.570 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:08:04.607 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:08:21.285 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:08:21.346 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:08:21.421 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:08:38.628 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:08:38.828 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:08:38.902 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:08:54.976 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:08:55.321 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:08:55.355 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:09:10.350 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:09:11.618 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-07-24T05:09:11.944 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:09:12.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:09:15.728 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:09:21.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:09:24.784 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:09:25.706 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:09:28.375 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:09:30.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:09:33.840 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:09:39.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:09:41.367 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:09:42.928 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:09:44.610 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:09:48.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:09:51.984 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:09:57.663 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:09:57.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:10:00.335 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:10:01.040 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:10:07.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:10:10.132 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:10:13.296 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:10:15.843 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:10:16.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:10:19.184 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:10:25.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:10:28.240 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-07-24T05:10:29.346 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:10:31.212 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:10:34.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:10:44.856 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:10:46.531 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:11:00.235 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:11:01.871 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:11:15.757 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:11:17.230 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:11:31.154 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:11:32.544 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:11:34.248 WARNING:teuthology.provision.fog.smithi039:timed out 2023-07-24T05:11:40.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:11:40.448 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:11:40.449 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:11:40.775 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-07-24T05:11:40.775 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2023-07-24T05:11:40.790 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-07-24T05:11:40.790 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2023-07-24T05:11:40.845 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-07-24T05:11:40.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-07-24T05:11:40.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2023-07-24T05:11:41.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2023-07-24T05:11:41.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2023-07-24T05:11:41.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-07-24T05:11:41.217 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-07-24T05:11:41.272 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2023-07-24T05:11:41.272 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2023-07-24T05:11:41.272 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2023-07-24T05:11:41.272 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:11:41.272 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:11:41.273 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:11:41.274 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:11:41.274 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:11:41.274 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-07-24T05:11:41.276 DEBUG:teuthology.parallel:result is None 2023-07-24T05:11:46.574 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:11:47.840 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:12:01.965 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:12:03.147 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:12:17.336 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:12:18.452 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:12:32.716 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:12:33.746 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:12:48.148 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:12:49.062 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:13:03.632 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:13:04.340 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:13:19.008 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:13:19.634 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:13:34.296 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:13:34.923 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:13:49.606 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:13:50.202 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:14:04.912 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:14:05.467 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:14:20.164 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:14:20.706 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:14:35.408 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:14:35.965 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:14:50.684 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:14:51.194 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:15:05.924 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:15:06.427 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:15:21.128 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:15:21.635 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:15:36.352 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:15:36.844 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:15:51.552 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:15:52.037 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:16:06.736 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:16:07.208 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:16:21.920 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:16:22.376 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:16:37.068 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:16:37.543 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:16:52.236 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:16:52.711 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:17:07.384 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:17:07.869 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:17:22.534 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:17:23.015 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:17:37.694 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-24T05:17:37.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:17:37.927 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: Authentication failed. 2023-07-24T05:17:37.928 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:17:37.929 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:17:37.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-24T05:17:38.175 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:17:38.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-24T05:17:39.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-24T05:17:53.330 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:18:08.485 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:18:23.626 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:18:38.750 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:18:53.846 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-24T05:18:53.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:57.008 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-24T05:19:03.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:06.064 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-24T05:19:12.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:15.120 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-24T05:19:21.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:24.176 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-24T05:19:27.348 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-24T05:19:27.349 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi040 2023-07-24T05:19:30.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:36.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-24T05:19:36.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:36.583 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-24T05:19:36.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-24T05:19:36.906 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:19:36.906 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:19:36.920 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-07-24T05:19:36.921 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-07-24T05:19:36.975 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-07-24T05:19:36.976 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-07-24T05:19:37.031 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-07-24T05:19:37.031 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-24T05:19:37.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-07-24T05:19:37.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-07-24T05:19:37.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-07-24T05:19:37.317 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-24T05:19:37.387 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-24T05:19:37.442 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-07-24T05:19:37.442 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-07-24T05:19:37.442 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-07-24T05:19:37.442 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:19:37.443 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:19:37.444 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:19:37.444 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:19:37.444 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:19:37.444 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-07-24T05:19:37.445 DEBUG:teuthology.parallel:result is None 2023-07-24T05:20:30.183 WARNING:teuthology.provision.fog.smithi045:timed out 2023-07-24T05:20:36.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:36.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:20:36.385 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:20:36.750 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-07-24T05:20:36.751 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-07-24T05:20:36.766 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-07-24T05:20:36.767 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-07-24T05:20:36.821 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-07-24T05:20:36.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-24T05:20:36.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-07-24T05:20:36.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-07-24T05:20:37.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-07-24T05:20:37.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-24T05:20:37.177 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-24T05:20:37.232 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-07-24T05:20:37.232 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2023-07-24T05:20:37.232 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-07-24T05:20:37.232 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:20:37.233 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:20:37.234 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:37.234 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:20:37.234 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:20:37.234 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-07-24T05:20:37.234 DEBUG:teuthology.parallel:result is None 2023-07-24T05:20:37.428 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-07-24T05:20:37.429 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:20:37.461 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-07-24T05:20:37.461 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:20:37.485 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2023-07-24T05:20:37.486 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:20:37.504 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:37.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-07-24T05:20:37.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:37.604 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-07-24T05:20:37.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-07-24T05:20:37.791 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-07-24T05:20:37.846 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-07-24T05:20:37.846 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-07-24T05:20:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2023-07-24T05:20:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2023-07-24T05:20:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2023-07-24T05:20:37.901 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:20:37.902 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:20:37.903 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:37.903 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:20:37.903 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:20:37.904 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-07-24T05:20:37.928 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:37.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-24T05:20:37.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:38.026 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-24T05:20:38.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-24T05:20:38.056 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-07-24T05:20:38.113 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-07-24T05:20:38.113 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-24T05:20:38.170 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-07-24T05:20:38.170 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2023-07-24T05:20:38.170 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:20:38.171 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:20:38.172 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:20:38.172 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:38.172 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:20:38.172 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:20:38.173 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-24T05:20:38.194 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:38.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-24T05:20:38.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:38.293 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-07-24T05:20:38.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-07-24T05:20:38.365 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-07-24T05:20:38.420 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-07-24T05:20:38.421 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-24T05:20:38.477 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-07-24T05:20:38.478 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2023-07-24T05:20:38.478 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-07-24T05:20:38.478 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-07-24T05:20:38.478 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2023-07-24T05:20:38.478 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2023-07-24T05:20:38.478 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-24T05:20:38.479 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-24T05:20:38.480 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-24T05:20:38.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:20:38.503 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:20:38.614 INFO:teuthology.dispatcher.supervisor:Running job 7349251 2023-07-24T05:20:38.614 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_1426592083662fef3e03bbeec33624331f0fdbc1/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349251 --name vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349251/orig.config.yaml 2023-07-24T05:20:38.617 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349251 2023-07-24T05:20:38.618 INFO:teuthology.dispatcher.supervisor:Job PID: 587 2023-07-24T05:20:38.618 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-24T05:22:38.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:22:38.719 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:22:38.800 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-24T05:22:38.958 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-24T05:22:38.958 INFO:teuthology.nuke:Checking targets against current locks 2023-07-24T05:22:39.012 DEBUG:teuthology.nuke:shortname: smithi039 2023-07-24T05:22:39.013 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:22:39.040 DEBUG:teuthology.nuke:shortname: smithi040 2023-07-24T05:22:39.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:22:39.044 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:07.729555', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNIfcMhVrUg43YgxkLiMgjCrzL9oAH5McTcSWfaM5vG3EMo2KAQ6bL8V+hfNWnYKZq1j4k+0+vDE6rLOjBxHXfw='} 2023-07-24T05:22:39.067 DEBUG:teuthology.nuke:shortname: smithi045 2023-07-24T05:22:39.067 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:22:39.070 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:07.730826', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYv1o8xa38Onj0XLLinCd/qm+l1kUoCwQ7p9k3UoRGcAKyUH9WuzEr20Tus4uKiHD4lH7OyIXWFI4KIgMVOrYE='} 2023-07-24T05:22:39.093 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349251', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:07.732038', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMlA6aF71wYhonCPJX3FPaVQ9rQy0GCWNHcnPNdYoydBRLrnsBCQM92+6pHAah+QYMrrbsacFuEj2NYUPbqhFi4='} 2023-07-24T05:22:39.103 INFO:teuthology.orchestra.console:Power off smithi039 2023-07-24T05:22:39.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:22:39.125 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:22:39.126 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:22:39.143 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-24T05:22:39.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:22:39.157 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-24T05:22:39.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:22:39.166 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:22:39.168 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:22:39.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:22:39.184 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:22:39.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:22:39.195 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:22:39.210 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:22:39.268 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-07-24T05:22:39.296 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-24T05:22:39.311 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-24T05:22:39.426 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2023-07-24T05:22:39.450 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-07-24T05:22:39.457 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com