2023-11-09T21:44:52.203 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T21:44:52.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:44:52.415 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f17492a7ac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1749dad670>, signals=[15])
2023-11-09T21:44:52.416 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2023-11-09T21:44:52.416 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T21:44:52.417 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-11-09T21:44:52.436 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2023-11-09T21:44:52.437 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T21:44:52.437 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-11-09T21:44:52.439 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"}
2023-11-09T21:44:52.460 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-11-09T21:44:52.461 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T21:44:52.461 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-11-09T21:44:52.463 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"}
2023-11-09T21:44:52.487 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /host {"name": "smithi196"}
2023-11-09T21:44:52.506 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T21:44:52.537 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T21:44:52.551 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T21:44:52.556 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T21:44:52.556 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 3}
2023-11-09T21:44:52.576 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T21:44:52.576 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 3}
2023-11-09T21:44:52.590 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T21:44:52.590 DEBUG:teuthology.provision.fog.smithi196:FOG request: PUT /host/301 {"imageID": 3}
2023-11-09T21:44:52.599 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 8.stream
2023-11-09T21:44:52.600 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:44:52.615 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream
2023-11-09T21:44:52.615 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:44:52.636 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2023-11-09T21:44:52.636 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-11-09T21:44:52.661 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T21:44:52.675 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T21:44:52.698 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T21:44:52.701 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1}
2023-11-09T21:44:52.711 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1}
2023-11-09T21:44:52.734 DEBUG:teuthology.provision.fog.smithi196:FOG request: POST /host/301/task {"taskTypeID": 1}
2023-11-09T21:44:52.750 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:44:52.754 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:44:52.786 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-11-09T21:44:52.854 INFO:teuthology.orchestra.console.smithi086:Power off
2023-11-09T21:44:52.855 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T21:44:52.870 INFO:teuthology.orchestra.console.smithi032:Power off
2023-11-09T21:44:52.871 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T21:44:52.880 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off
2023-11-09T21:44:52.881 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:52.891 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2023-11-09T21:44:52.892 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:52.904 INFO:teuthology.orchestra.console.smithi196:Power off
2023-11-09T21:44:52.905 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T21:44:52.916 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2023-11-09T21:44:52.917 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2023-11-09T21:44:52.929 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-11-09T21:44:52.929 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:52.951 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-11-09T21:44:56.918 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:56.927 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:56.952 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:44:57.029 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2023-11-09T21:44:57.035 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2023-11-09T21:44:57.061 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-11-09T21:45:01.034 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:01.041 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:01.063 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:01.143 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2023-11-09T21:45:01.150 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2023-11-09T21:45:01.173 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-11-09T21:45:05.148 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:05.155 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:05.174 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:05.257 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2023-11-09T21:45:05.263 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-11-09T21:45:05.282 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-11-09T21:45:05.359 INFO:teuthology.orchestra.console.smithi086:Power off completed
2023-11-09T21:45:05.364 INFO:teuthology.orchestra.console.smithi032:Power off completed
2023-11-09T21:45:05.383 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-11-09T21:45:05.460 INFO:teuthology.orchestra.console.smithi086:Power on
2023-11-09T21:45:05.461 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T21:45:05.468 INFO:teuthology.orchestra.console.smithi032:Power on
2023-11-09T21:45:05.468 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T21:45:05.485 INFO:teuthology.orchestra.console.smithi196:Power on
2023-11-09T21:45:05.485 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T21:45:05.493 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2023-11-09T21:45:05.494 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:05.500 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On
2023-11-09T21:45:05.500 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:05.511 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2023-11-09T21:45:05.511 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:05.521 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-11-09T21:45:05.524 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2023-11-09T21:45:05.533 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-11-09T21:45:09.522 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:09.529 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:09.537 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T21:45:09.631 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2023-11-09T21:45:09.639 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on
2023-11-09T21:45:09.646 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-11-09T21:45:09.732 INFO:teuthology.orchestra.console.smithi032:Power on completed
2023-11-09T21:45:09.740 INFO:teuthology.orchestra.console.smithi086:Power on completed
2023-11-09T21:45:09.746 INFO:teuthology.orchestra.console.smithi196:Power on completed
2023-11-09T21:45:09.833 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2023-11-09T21:45:09.834 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:45:09.841 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2023-11-09T21:45:09.841 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:45:09.848 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-11-09T21:45:09.848 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-11-09T21:45:09.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:45:13.050 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:45:19.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:45:22.106 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:45:24.987 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:45:24.990 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:45:28.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:45:31.166 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:45:37.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:45:40.138 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:45:40.150 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:45:40.250 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:45:46.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:45:49.338 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:45:55.292 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:45:55.300 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:45:55.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:45:58.394 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:46:04.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:46:07.482 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:46:10.458 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:46:10.463 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:46:13.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:46:16.538 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:46:22.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:46:25.606 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:46:25.612 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:46:32.698 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:46:38.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:46:40.810 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:46:40.813 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:46:41.758 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:46:47.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:46:48.094 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:46:54.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:46:54.228 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:46:55.963 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:46:55.966 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:46:58.356 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:47:05.485 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:47:11.157 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:47:11.160 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:47:15.613 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:47:26.320 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:47:26.324 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:47:28.742 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:47:41.521 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:47:41.524 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:47:44.869 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:47:56.721 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:47:56.724 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:48:03.998 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:48:11.951 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:48:11.954 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:48:26.126 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:48:27.156 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:48:27.160 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:48:42.326 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:48:42.332 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:48:51.255 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:48:57.512 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:48:57.516 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:49:12.703 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-11-09T21:49:12.708 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:49:12.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:16.026 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-11-09T21:49:19.383 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:49:19.384 WARNING:teuthology.provision.fog.smithi196:'connect to smithi196.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-11-09T21:49:22.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:25.082 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-11-09T21:49:25.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:25.512 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:49:27.948 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:49:29.640 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:49:31.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:34.138 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-11-09T21:49:36.769 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:49:40.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:43.169 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:49:43.194 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-11-09T21:49:46.898 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:49:49.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:52.250 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2023-11-09T21:49:58.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:49:58.354 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:50:00.026 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:50:13.566 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:50:16.155 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:50:28.728 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:50:35.284 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:50:43.892 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:50:57.412 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:50:58.254 WARNING:teuthology.provision.fog.smithi032:timed out
2023-11-09T21:50:59.026 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:51:04.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:04.494 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T21:51:04.495 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T21:51:04.753 INFO:teuthology.provision.fog.smithi032:Node is ready
2023-11-09T21:51:04.754 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2023-11-09T21:51:04.775 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2023-11-09T21:51:04.775 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2023-11-09T21:51:04.836 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2023-11-09T21:51:04.837 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2023-11-09T21:51:04.941 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2023-11-09T21:51:04.972 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2023-11-09T21:51:05.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2023-11-09T21:51:05.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2023-11-09T21:51:05.183 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2023-11-09T21:51:05.241 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2023-11-09T21:51:05.242 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8"
2023-11-09T21:51:05.242 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2023-11-09T21:51:05.242 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2023-11-09T21:51:05.242 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8"
2023-11-09T21:51:05.242 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:51:05.243 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T21:51:05.243 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2023-11-09T21:51:05.243 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T21:51:05.243 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2023-11-09T21:51:05.243 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:51:05.244 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:51:05.244 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T21:51:05.245 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2023-11-09T21:51:05.246 DEBUG:teuthology.parallel:result is None
2023-11-09T21:51:14.133 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-11-09T21:51:14.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:14.507 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:51:22.541 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:51:50.631 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:51:50.631 WARNING:teuthology.provision.fog.smithi196:'connect to smithi196.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-11-09T21:51:56.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:51:56.761 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:52:00.888 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:52:08.016 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T21:52:18.511 WARNING:teuthology.provision.fog.smithi086:timed out
2023-11-09T21:52:24.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:27.578 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-11-09T21:52:33.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:36.634 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-11-09T21:52:42.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:45.691 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-11-09T21:52:49.786 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:52:51.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:52.214 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T21:52:52.214 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T21:52:55.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:52:58.842 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:53:04.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:53:07.898 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-11-09T21:53:12.324 INFO:teuthology.provision.fog.smithi086:Node is ready
2023-11-09T21:53:12.324 DEBUG:teuthology.orchestra.run.smithi086:> hostname
2023-11-09T21:53:12.346 INFO:teuthology.orchestra.run.smithi086.stdout:smithi193
2023-11-09T21:53:12.346 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi193 /etc/hosts
2023-11-09T21:53:12.405 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2023-11-09T21:53:12.405 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2023-11-09T21:53:12.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi193/smithi086/g' /etc/hosts
2023-11-09T21:53:12.572 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.193/172.21.15.86/g' /etc/hosts
2023-11-09T21:53:12.642 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi193/smithi086/g' /etc/hostname
2023-11-09T21:53:12.711 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086
2023-11-09T21:53:12.779 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2023-11-09T21:53:12.837 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2023-11-09T21:53:12.837 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8"
2023-11-09T21:53:12.837 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2023-11-09T21:53:12.837 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2023-11-09T21:53:12.837 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8"
2023-11-09T21:53:12.838 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:53:12.838 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T21:53:12.838 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2023-11-09T21:53:12.838 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T21:53:12.838 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2023-11-09T21:53:12.839 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:53:12.839 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:53:12.839 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T21:53:12.839 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2023-11-09T21:53:12.840 DEBUG:teuthology.parallel:result is None
2023-11-09T21:53:13.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:54:13.905 WARNING:teuthology.provision.fog.smithi196:timed out
2023-11-09T21:54:19.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:54:20.128 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T21:54:20.128 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T21:54:20.409 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-11-09T21:54:20.410 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-11-09T21:54:20.430 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2023-11-09T21:54:20.431 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2023-11-09T21:54:20.493 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-11-09T21:54:20.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-11-09T21:54:20.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2023-11-09T21:54:20.630 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-11-09T21:54:20.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2023-11-09T21:54:20.769 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-11-09T21:54:20.838 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-11-09T21:54:20.896 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-11-09T21:54:20.896 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2023-11-09T21:54:20.896 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-11-09T21:54:20.896 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-11-09T21:54:20.897 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2023-11-09T21:54:20.897 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:54:20.897 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T21:54:20.897 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-11-09T21:54:20.897 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T21:54:20.898 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-11-09T21:54:20.898 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:54:20.898 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:54:20.898 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T21:54:20.899 INFO:teuthology.provision.fog.smithi196:Deploy complete!
2023-11-09T21:54:20.899 DEBUG:teuthology.parallel:result is None
2023-11-09T21:54:21.098 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2023-11-09T21:54:21.099 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T21:54:21.119 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com
2023-11-09T21:54:21.120 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T21:54:21.136 INFO:teuthology.lock.ops:Checking smithi196.front.sepia.ceph.com
2023-11-09T21:54:21.136 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T21:54:21.149 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2023-11-09T21:54:21.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2023-11-09T21:54:21.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:54:21.219 DEBUG:teuthology.orchestra.run.smithi032:> true
2023-11-09T21:54:21.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2023-11-09T21:54:21.354 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2023-11-09T21:54:21.412 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2023-11-09T21:54:21.413 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2023-11-09T21:54:21.472 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2023-11-09T21:54:21.472 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8"
2023-11-09T21:54:21.472 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2023-11-09T21:54:21.472 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2023-11-09T21:54:21.473 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8"
2023-11-09T21:54:21.473 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:54:21.473 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T21:54:21.473 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2023-11-09T21:54:21.473 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T21:54:21.474 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2023-11-09T21:54:21.474 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:54:21.474 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:54:21.474 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T21:54:21.475 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-11-09T21:54:21.495 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server
2023-11-09T21:54:21.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-11-09T21:54:21.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:54:21.562 DEBUG:teuthology.orchestra.run.smithi086:> true
2023-11-09T21:54:21.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-11-09T21:54:21.702 DEBUG:teuthology.orchestra.run.smithi086:> uname -m
2023-11-09T21:54:21.761 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64
2023-11-09T21:54:21.761 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release
2023-11-09T21:54:21.819 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2023-11-09T21:54:21.820 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8"
2023-11-09T21:54:21.820 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2023-11-09T21:54:21.820 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2023-11-09T21:54:21.820 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8"
2023-11-09T21:54:21.821 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:54:21.821 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T21:54:21.821 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2023-11-09T21:54:21.821 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T21:54:21.821 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2023-11-09T21:54:21.822 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:54:21.822 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:54:21.822 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T21:54:21.823 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-11-09T21:54:21.845 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: set os type and version on server
2023-11-09T21:54:21.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-11-09T21:54:21.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T21:54:21.913 DEBUG:teuthology.orchestra.run.smithi196:> true
2023-11-09T21:54:21.984 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com'
2023-11-09T21:54:21.984 DEBUG:teuthology.orchestra.run.smithi196:> uname -m
2023-11-09T21:54:22.043 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64
2023-11-09T21:54:22.043 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-11-09T21:54:22.101 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream"
2023-11-09T21:54:22.102 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8"
2023-11-09T21:54:22.102 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos"
2023-11-09T21:54:22.103 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora"
2023-11-09T21:54:22.103 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8"
2023-11-09T21:54:22.103 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-11-09T21:54:22.103 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T21:54:22.104 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-11-09T21:54:22.104 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T21:54:22.104 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/"
2023-11-09T21:54:22.104 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T21:54:22.104 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T21:54:22.105 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T21:54:22.105 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-11-09T21:54:22.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:54:22.216 INFO:teuthology.dispatcher.supervisor:Running job 7453148
2023-11-09T21:54:22.216 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453148 --name yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay subvolume/{no-subvolume} tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453148/orig.config.yaml
2023-11-09T21:54:22.219 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453148
2023-11-09T21:54:22.219 INFO:teuthology.dispatcher.supervisor:Job PID: 3301568
2023-11-09T21:54:22.220 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T21:56:22.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T21:58:22.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:00:22.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:02:22.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T22:02:22.496 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T22:02:22.644 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi196 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453177
2023-11-09T22:02:22.644 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T22:02:22.644 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T22:02:22.699 DEBUG:teuthology.nuke:shortname: smithi032
2023-11-09T22:02:22.700 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:02:22.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453148', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 21:44:51.393597', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMA7Iem/4UnGLoH1Tb3eHUiS/MoT/aIEEXM33JWzwql77ZipOVuNVWvgDyBr6KKbrQqR55nMZeI50uLiJ/YTYxc='}
2023-11-09T22:02:22.727 DEBUG:teuthology.nuke:shortname: smithi086
2023-11-09T22:02:22.727 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:02:22.749 DEBUG:teuthology.nuke:shortname: smithi196
2023-11-09T22:02:22.750 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T22:02:22.755 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453148', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 21:44:51.396320', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIb2bAdh2wXW6s8CmlXt5BggzsykFy0PcB3JYFguz3HbtXQ1DwTQqKFQO7/LiRh60VxZGjfoi7ssRUdyg3Z/SCc='}
2023-11-09T22:02:22.786 INFO:teuthology.orchestra.console.smithi032:Power off
2023-11-09T22:02:22.787 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:02:22.803 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453177', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 21:58:23.811881', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWXyT9uP88D+D0kmN1SoXc9AvPasdyhqgSgH2EIDBVAYzeyWdw3Fd5T9V3nfrt5Taw0iKyp0NaizFNDQ9qQ40I='}
2023-11-09T22:02:22.829 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2023-11-09T22:02:22.830 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:02:22.861 INFO:teuthology.orchestra.console.smithi086:Power off
2023-11-09T22:02:22.862 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:02:22.879 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2023-11-09T22:02:22.887 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off
2023-11-09T22:02:22.888 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:02:22.910 INFO:teuthology.orchestra.console.smithi196:Power off
2023-11-09T22:02:22.911 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T22:02:22.934 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off
2023-11-09T22:02:22.962 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-11-09T22:02:22.963 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T22:02:22.981 INFO:teuthology.orchestra.console.smithi032:Power off completed
2023-11-09T22:02:22.998 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-11-09T22:02:23.036 INFO:teuthology.orchestra.console.smithi086:Power off completed
2023-11-09T22:02:23.101 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-11-09T22:02:23.136 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2023-11-09T22:02:23.185 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com
2023-11-09T22:02:23.370 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com