2023-10-21T09:31:47.558 INFO:root:teuthology version: 0.0.1.dev201+g202b180
2023-10-21T09:31:47.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:31:47.744 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f574ae72b20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f574b976670>, signals=[15])
2023-10-21T09:31:47.746 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-10-21T09:31:47.746 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-10-21T09:31:47.746 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-10-21T09:31:47.774 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-10-21T09:31:47.775 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-10-21T09:31:47.775 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-21T09:31:47.777 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-10-21T09:31:47.803 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2023-10-21T09:31:47.804 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2023-10-21T09:31:47.804 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2023-10-21T09:31:47.805 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-10-21T09:31:47.830 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"}
2023-10-21T09:31:47.856 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-21T09:31:47.865 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-21T09:31:47.891 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-21T09:31:47.895 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_9.stream (ID 10)
2023-10-21T09:31:47.895 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 10}
2023-10-21T09:31:47.908 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10)
2023-10-21T09:31:47.908 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 10}
2023-10-21T09:31:47.931 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10)
2023-10-21T09:31:47.932 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 10}
2023-10-21T09:31:47.955 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 9.stream
2023-10-21T09:31:47.956 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:31:47.961 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream
2023-10-21T09:31:47.961 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:31:47.991 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream
2023-10-21T09:31:47.991 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:31:48.038 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-10-21T09:31:48.042 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-10-21T09:31:48.062 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"}
2023-10-21T09:31:48.079 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-10-21T09:31:48.082 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-10-21T09:31:48.106 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1}
2023-10-21T09:31:48.138 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:31:48.142 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:31:48.158 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:31:48.256 INFO:teuthology.orchestra.console.smithi079:Power off
2023-10-21T09:31:48.257 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-21T09:31:48.270 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-21T09:31:48.270 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-21T09:31:48.280 INFO:teuthology.orchestra.console.smithi175:Power off
2023-10-21T09:31:48.281 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-21T09:31:48.289 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-10-21T09:31:48.290 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:48.299 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-21T09:31:48.299 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:48.308 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2023-10-21T09:31:48.309 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:48.317 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-10-21T09:31:48.321 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-21T09:31:48.331 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2023-10-21T09:31:48.422 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-21T09:31:48.522 INFO:teuthology.orchestra.console.smithi099:Power on
2023-10-21T09:31:48.523 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-21T09:31:48.545 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-10-21T09:31:48.545 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:48.570 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-21T09:31:52.322 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:52.332 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:52.432 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-10-21T09:31:52.443 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2023-10-21T09:31:52.571 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:52.681 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-21T09:31:56.434 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:56.443 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:56.545 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-10-21T09:31:56.552 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2023-10-21T09:31:56.683 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:31:56.792 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-21T09:31:56.893 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-10-21T09:31:56.993 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-10-21T09:31:56.994 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:32:00.546 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:00.553 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:00.656 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-21T09:32:00.662 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-10-21T09:32:00.758 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-10-21T09:32:00.763 INFO:teuthology.orchestra.console.smithi175:Power off completed
2023-10-21T09:32:00.859 INFO:teuthology.orchestra.console.smithi079:Power on
2023-10-21T09:32:00.860 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-21T09:32:00.867 INFO:teuthology.orchestra.console.smithi175:Power on
2023-10-21T09:32:00.868 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-21T09:32:00.915 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2023-10-21T09:32:00.916 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:00.930 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2023-10-21T09:32:00.931 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:00.947 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-21T09:32:00.961 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-10-21T09:32:04.950 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:04.962 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:05.061 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-10-21T09:32:05.072 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-10-21T09:32:05.162 INFO:teuthology.orchestra.console.smithi079:Power on completed
2023-10-21T09:32:05.263 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-10-21T09:32:05.263 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:32:09.074 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:32:09.185 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2023-10-21T09:32:09.286 INFO:teuthology.orchestra.console.smithi175:Power on completed
2023-10-21T09:32:09.386 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2023-10-21T09:32:09.387 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:32:12.102 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:32:20.358 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:32:24.470 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:32:27.189 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:32:35.438 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:32:39.542 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:32:42.270 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:32:50.515 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:32:54.614 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:32:57.350 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:33:05.582 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:33:09.682 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:33:12.417 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:33:20.654 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:33:24.746 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:33:27.486 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:33:35.722 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:33:39.814 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:33:42.550 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:33:50.790 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:33:54.874 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:33:57.619 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:34:05.878 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:34:09.958 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:34:12.706 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:34:20.958 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:34:25.042 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:34:27.785 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:34:36.033 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:34:40.118 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None
2023-10-21T09:34:40.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:34:42.860 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-21T09:34:42.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:34:51.098 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-21T09:34:51.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:34:58.682 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:35:01.242 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-21T09:35:04.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:07.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:07.742 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:35:09.694 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-21T09:35:10.298 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-21T09:35:13.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:15.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:16.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:16.830 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:35:18.782 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-21T09:35:19.359 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-21T09:35:22.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:24.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:25.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:25.914 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:35:27.866 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-21T09:35:28.446 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-21T09:35:31.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:33.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:34.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:34.970 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:35:36.926 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-21T09:35:40.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:42.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:35:59.354 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:36:05.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:08.414 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:36:14.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:17.498 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2023-10-21T09:36:23.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:23.721 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-21T09:36:23.722 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-21T09:36:34.452 WARNING:teuthology.provision.fog.smithi099:timed out
2023-10-21T09:36:39.090 INFO:teuthology.provision.fog.smithi175:Node is ready
2023-10-21T09:36:39.091 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2023-10-21T09:36:39.148 INFO:teuthology.orchestra.run.smithi175.stdout:smithi046
2023-10-21T09:36:39.148 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi046 /etc/hosts
2023-10-21T09:36:39.206 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2023-10-21T09:36:39.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2023-10-21T09:36:39.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi046/smithi175/g' /etc/hosts
2023-10-21T09:36:39.393 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.46/172.21.15.175/g' /etc/hosts
2023-10-21T09:36:39.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi046/smithi175/g' /etc/hostname
2023-10-21T09:36:39.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2023-10-21T09:36:39.606 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2023-10-21T09:36:39.662 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2023-10-21T09:36:39.662 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9"
2023-10-21T09:36:39.663 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2023-10-21T09:36:39.663 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2023-10-21T09:36:39.663 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9"
2023-10-21T09:36:39.663 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9"
2023-10-21T09:36:39.663 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-21T09:36:39.664 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2023-10-21T09:36:39.664 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon"
2023-10-21T09:36:39.664 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-21T09:36:39.664 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2023-10-21T09:36:39.664 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-21T09:36:39.665 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-21T09:36:39.665 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-21T09:36:39.665 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2023-10-21T09:36:39.667 DEBUG:teuthology.parallel:result is None
2023-10-21T09:36:40.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:40.809 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-21T09:36:40.810 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-21T09:36:41.137 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-10-21T09:36:41.138 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-10-21T09:36:41.153 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-10-21T09:36:41.154 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-10-21T09:36:41.209 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-10-21T09:36:41.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-21T09:36:41.329 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-10-21T09:36:41.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-10-21T09:36:41.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-10-21T09:36:41.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-21T09:36:41.562 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-21T09:36:41.617 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-21T09:36:41.617 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9"
2023-10-21T09:36:41.617 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-21T09:36:41.618 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-21T09:36:41.618 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9"
2023-10-21T09:36:41.618 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9"
2023-10-21T09:36:41.618 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-21T09:36:41.618 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-21T09:36:41.619 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon"
2023-10-21T09:36:41.619 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-21T09:36:41.619 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-21T09:36:41.619 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-21T09:36:41.619 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-21T09:36:41.620 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-21T09:36:41.620 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-10-21T09:36:41.621 DEBUG:teuthology.parallel:result is None
2023-10-21T09:36:42.933 WARNING:teuthology.provision.fog.smithi079:timed out
2023-10-21T09:36:48.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:49.175 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-21T09:36:49.175 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-21T09:36:49.475 INFO:teuthology.provision.fog.smithi079:Node is ready
2023-10-21T09:36:49.475 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2023-10-21T09:36:49.533 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2023-10-21T09:36:49.533 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2023-10-21T09:36:49.591 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2023-10-21T09:36:49.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-10-21T09:36:49.703 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2023-10-21T09:36:49.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2023-10-21T09:36:49.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2023-10-21T09:36:49.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-10-21T09:36:49.943 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-10-21T09:36:50.000 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2023-10-21T09:36:50.001 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2023-10-21T09:36:50.001 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2023-10-21T09:36:50.001 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2023-10-21T09:36:50.001 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2023-10-21T09:36:50.002 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2023-10-21T09:36:50.002 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-21T09:36:50.002 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-10-21T09:36:50.002 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2023-10-21T09:36:50.002 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-21T09:36:50.003 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2023-10-21T09:36:50.003 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-21T09:36:50.003 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-21T09:36:50.003 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-21T09:36:50.004 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2023-10-21T09:36:50.004 DEBUG:teuthology.parallel:result is None
2023-10-21T09:36:50.216 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2023-10-21T09:36:50.217 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-21T09:36:50.243 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-10-21T09:36:50.244 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-21T09:36:50.268 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com
2023-10-21T09:36:50.268 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-21T09:36:50.286 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2023-10-21T09:36:50.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-10-21T09:36:50.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:50.374 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-10-21T09:36:50.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-10-21T09:36:50.446 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2023-10-21T09:36:50.502 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2023-10-21T09:36:50.503 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-10-21T09:36:50.560 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2023-10-21T09:36:50.561 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9"
2023-10-21T09:36:50.561 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2023-10-21T09:36:50.561 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2023-10-21T09:36:50.561 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9"
2023-10-21T09:36:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9"
2023-10-21T09:36:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-21T09:36:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-10-21T09:36:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon"
2023-10-21T09:36:50.562 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-21T09:36:50.563 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2023-10-21T09:36:50.563 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-21T09:36:50.563 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-21T09:36:50.563 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-21T09:36:50.564 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-10-21T09:36:50.585 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-10-21T09:36:50.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-21T09:36:50.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:50.672 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-10-21T09:36:50.743 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-21T09:36:50.743 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-10-21T09:36:50.800 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-10-21T09:36:50.800 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-21T09:36:50.856 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-21T09:36:50.857 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9"
2023-10-21T09:36:50.857 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-21T09:36:50.857 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-21T09:36:50.857 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9"
2023-10-21T09:36:50.858 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9"
2023-10-21T09:36:50.858 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-21T09:36:50.858 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-21T09:36:50.858 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon"
2023-10-21T09:36:50.859 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-21T09:36:50.859 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-21T09:36:50.859 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-21T09:36:50.859 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-21T09:36:50.860 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-21T09:36:50.861 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-21T09:36:50.885 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server
2023-10-21T09:36:50.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com'
2023-10-21T09:36:50.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-21T09:36:50.970 DEBUG:teuthology.orchestra.run.smithi175:> true
2023-10-21T09:36:51.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com'
2023-10-21T09:36:51.145 DEBUG:teuthology.orchestra.run.smithi175:> uname -m
2023-10-21T09:36:51.198 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64
2023-10-21T09:36:51.199 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2023-10-21T09:36:51.253 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2023-10-21T09:36:51.253 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9"
2023-10-21T09:36:51.253 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2023-10-21T09:36:51.253 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2023-10-21T09:36:51.254 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9"
2023-10-21T09:36:51.254 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9"
2023-10-21T09:36:51.254 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-21T09:36:51.254 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2023-10-21T09:36:51.254 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon"
2023-10-21T09:36:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-21T09:36:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2023-10-21T09:36:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-21T09:36:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-21T09:36:51.255 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-21T09:36:51.256 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2023-10-21T09:36:51.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:36:51.375 INFO:teuthology.dispatcher.supervisor:Running job 7433789
2023-10-21T09:36:51.375 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433789 --name yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433789/orig.config.yaml
2023-10-21T09:36:51.378 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433789
2023-10-21T09:36:51.379 INFO:teuthology.dispatcher.supervisor:Job PID: 2380920
2023-10-21T09:36:51.379 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-21T09:38:51.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:40:51.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:42:51.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:44:52.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:46:52.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:48:52.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:50:52.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-21T09:50:52.591 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-21T09:50:52.713 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-21T09:50:52.714 INFO:teuthology.nuke:Checking targets against current locks
2023-10-21T09:50:52.768 DEBUG:teuthology.nuke:shortname: smithi079
2023-10-21T09:50:52.769 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-21T09:50:52.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 09:31:46.656285', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHgMRGdry8ybV9A1mUbKEgqi9JEFaP7VPfRHtdgHgFmxrTqrYv6M2q+sE7YRxdzdlQHM6BynvjhfJmcq1HOPs2c='}
2023-10-21T09:50:52.793 DEBUG:teuthology.nuke:shortname: smithi099
2023-10-21T09:50:52.793 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-21T09:50:52.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 09:31:46.657706', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmKW5FVeRSexvjUmOBro7gbdCK8wkpOFkTQW7z1hWPODJUCmS5RXMCsLk148XovBkp/V14y1gAKPmqQLWpYn48='}
2023-10-21T09:50:52.826 DEBUG:teuthology.nuke:shortname: smithi175
2023-10-21T09:50:52.826 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-21T09:50:52.853 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-20_18:40:51-rados-main-distro-default-smithi/7433789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 09:31:46.658853', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMpURkNKNEeZCTqwhaGlWfRwIwKKjR9ayaC+xsckKDmn94sv9Qc/uvT6N2PVaKesBWoB4lK4IBmTb4FrWTa1fC4='}
2023-10-21T09:50:52.860 INFO:teuthology.orchestra.console.smithi079:Power off
2023-10-21T09:50:52.860 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-21T09:50:52.883 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-10-21T09:50:52.884 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:50:52.898 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-21T09:50:52.898 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-21T09:50:52.910 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-21T09:50:52.923 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-21T09:50:52.924 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:50:52.943 INFO:teuthology.orchestra.console.smithi175:Power off
2023-10-21T09:50:52.943 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-21T09:50:52.952 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-21T09:50:52.967 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2023-10-21T09:50:52.967 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-21T09:50:52.990 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2023-10-21T09:50:53.011 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-10-21T09:50:53.053 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-21T09:50:53.092 INFO:teuthology.orchestra.console.smithi175:Power off completed
2023-10-21T09:50:53.158 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com
2023-10-21T09:50:53.198 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2023-10-21T09:50:53.240 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com