2023-11-01T02:58:49.298 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-01T02:58:49.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T02:58:49.502 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7feaf30ffbb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7feaf2ea1c10>, signals=[15])
2023-11-01T02:58:49.503 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging
2023-11-01T02:58:49.504 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T02:58:49.504 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-11-01T02:58:49.527 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2023-11-01T02:58:49.528 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T02:58:49.528 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-11-01T02:58:49.533 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"}
2023-11-01T02:58:49.559 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging
2023-11-01T02:58:49.560 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T02:58:49.560 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2023-11-01T02:58:49.561 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"}
2023-11-01T02:58:49.584 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging
2023-11-01T02:58:49.584 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T02:58:49.585 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-11-01T02:58:49.586 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"}
2023-11-01T02:58:49.600 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"}
2023-11-01T02:58:49.624 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T02:58:49.656 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T02:58:49.746 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T02:58:49.746 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 10}
2023-11-01T02:58:49.749 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T02:58:49.750 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 10}
2023-11-01T02:58:49.762 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T02:58:49.765 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T02:58:49.798 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 9.stream
2023-11-01T02:58:49.798 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T02:58:49.801 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 9.stream
2023-11-01T02:58:49.801 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T02:58:49.807 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T02:58:49.807 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 10}
2023-11-01T02:58:49.814 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T02:58:49.814 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 10}
2023-11-01T02:58:49.841 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T02:58:49.849 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T02:58:49.857 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream
2023-11-01T02:58:49.857 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T02:58:49.861 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream
2023-11-01T02:58:49.861 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T02:58:49.882 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1}
2023-11-01T02:58:49.891 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1}
2023-11-01T02:58:49.897 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T02:58:49.903 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T02:58:49.927 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1}
2023-11-01T02:58:49.943 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1}
2023-11-01T02:58:49.956 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T02:58:49.969 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T02:58:49.977 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T02:58:50.007 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T02:58:50.053 INFO:teuthology.orchestra.console.smithi057:Power off
2023-11-01T02:58:50.054 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T02:58:50.072 INFO:teuthology.orchestra.console.smithi114:Power off
2023-11-01T02:58:50.072 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T02:58:50.083 INFO:teuthology.orchestra.console.smithi190:Power off
2023-11-01T02:58:50.084 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T02:58:50.094 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-11-01T02:58:50.094 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:50.102 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2023-11-01T02:58:50.103 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:50.111 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2023-11-01T02:58:50.112 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:50.124 INFO:teuthology.orchestra.console.smithi195:Power off
2023-11-01T02:58:50.124 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T02:58:50.132 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-11-01T02:58:50.133 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-11-01T02:58:50.133 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2023-11-01T02:58:50.148 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off
2023-11-01T02:58:50.149 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:50.170 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-11-01T02:58:50.271 INFO:teuthology.orchestra.console.smithi195:Power off completed
2023-11-01T02:58:50.372 INFO:teuthology.orchestra.console.smithi195:Power on
2023-11-01T02:58:50.372 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T02:58:50.393 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On
2023-11-01T02:58:50.394 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:50.415 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-11-01T02:58:54.134 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:54.142 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:54.149 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:54.244 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-11-01T02:58:54.250 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-11-01T02:58:54.257 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2023-11-01T02:58:54.417 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:54.527 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on
2023-11-01T02:58:54.628 INFO:teuthology.orchestra.console.smithi195:Power on completed
2023-11-01T02:58:54.728 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2023-11-01T02:58:54.729 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T02:58:58.249 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:58.257 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:58.263 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:58.360 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-01T02:58:58.365 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-11-01T02:58:58.372 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2023-11-01T02:58:58.461 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-11-01T02:58:58.562 INFO:teuthology.orchestra.console.smithi057:Power on
2023-11-01T02:58:58.562 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T02:58:58.585 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On
2023-11-01T02:58:58.586 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:58:58.608 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-01T02:59:02.366 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:02.375 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:02.477 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-11-01T02:59:02.484 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-01T02:59:02.579 INFO:teuthology.orchestra.console.smithi190:Power off completed
2023-11-01T02:59:02.585 INFO:teuthology.orchestra.console.smithi114:Power off completed
2023-11-01T02:59:02.610 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:02.680 INFO:teuthology.orchestra.console.smithi190:Power on
2023-11-01T02:59:02.680 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T02:59:02.687 INFO:teuthology.orchestra.console.smithi114:Power on
2023-11-01T02:59:02.688 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T02:59:02.701 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On
2023-11-01T02:59:02.702 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:02.711 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On
2023-11-01T02:59:02.711 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:02.719 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-01T02:59:02.723 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-11-01T02:59:02.732 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-01T02:59:06.722 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:06.729 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:06.736 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T02:59:06.831 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-11-01T02:59:06.838 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-11-01T02:59:06.845 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on
2023-11-01T02:59:06.932 INFO:teuthology.orchestra.console.smithi057:Power on completed
2023-11-01T02:59:06.939 INFO:teuthology.orchestra.console.smithi190:Power on completed
2023-11-01T02:59:06.946 INFO:teuthology.orchestra.console.smithi114:Power on completed
2023-11-01T02:59:07.033 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2023-11-01T02:59:07.034 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T02:59:07.040 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2023-11-01T02:59:07.040 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T02:59:07.047 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2023-11-01T02:59:07.047 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T02:59:09.794 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T02:59:22.101 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T02:59:22.104 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T02:59:22.112 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T02:59:24.862 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T02:59:37.159 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T02:59:37.161 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T02:59:37.165 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T02:59:39.925 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T02:59:52.226 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T02:59:52.235 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T02:59:52.236 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T02:59:54.990 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:00:07.298 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:00:07.304 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:00:07.306 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:00:10.054 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:00:22.370 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:00:22.372 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:00:22.379 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:00:25.117 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:00:37.442 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:00:37.444 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:00:37.445 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:00:40.178 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:00:52.519 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:00:52.520 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:00:52.521 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:00:55.231 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:01:07.586 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:01:07.588 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:01:07.589 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:01:10.290 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:01:22.658 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:01:22.660 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:01:22.661 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:01:25.349 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None
2023-11-01T03:01:25.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:01:25.697 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-01T03:01:37.717 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-11-01T03:01:37.720 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-01T03:01:37.722 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None
2023-11-01T03:01:37.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:01:37.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:01:37.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:01:37.883 ERROR:teuthology.orchestra.connection:Error authenticating with smithi057.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-01T03:01:37.933 ERROR:teuthology.orchestra.connection:Error authenticating with smithi114.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-01T03:01:56.222 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-11-01T03:02:02.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:05.310 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-11-01T03:02:11.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:14.362 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-11-01T03:02:20.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:23.418 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-11-01T03:02:29.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:29.701 WARNING:teuthology.provision.fog.smithi195:timed out
2023-11-01T03:02:32.474 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-11-01T03:02:35.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:38.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:41.885 WARNING:teuthology.provision.fog.smithi057:timed out
2023-11-01T03:02:41.936 WARNING:teuthology.provision.fog.smithi114:timed out
2023-11-01T03:02:47.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:47.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:02:54.078 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-11-01T03:03:00.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:03.130 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-11-01T03:03:06.366 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-11-01T03:03:09.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:09.447 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T03:03:09.448 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T03:03:12.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:15.450 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114
2023-11-01T03:03:21.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:21.722 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T03:03:21.723 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T03:03:24.774 INFO:teuthology.provision.fog.smithi195:Node is ready
2023-11-01T03:03:24.774 DEBUG:teuthology.orchestra.run.smithi195:> hostname
2023-11-01T03:03:24.792 INFO:teuthology.orchestra.run.smithi195.stdout:smithi046
2023-11-01T03:03:24.792 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi046 /etc/hosts
2023-11-01T03:03:24.850 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046
2023-11-01T03:03:24.851 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-11-01T03:03:25.003 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi046/smithi195/g' /etc/hosts
2023-11-01T03:03:25.036 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.46/172.21.15.195/g' /etc/hosts
2023-11-01T03:03:25.105 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi046/smithi195/g' /etc/hostname
2023-11-01T03:03:25.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195
2023-11-01T03:03:25.242 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release
2023-11-01T03:03:25.297 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream"
2023-11-01T03:03:25.298 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9"
2023-11-01T03:03:25.298 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos"
2023-11-01T03:03:25.298 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:25.298 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9"
2023-11-01T03:03:25.299 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:25.299 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:25.299 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:25.299 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:25.299 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:25.300 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:25.300 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:25.300 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:25.300 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:25.301 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2023-11-01T03:03:25.302 DEBUG:teuthology.parallel:result is None
2023-11-01T03:03:38.478 WARNING:teuthology.provision.fog.smithi190:timed out
2023-11-01T03:03:42.051 INFO:teuthology.provision.fog.smithi114:Node is ready
2023-11-01T03:03:42.051 DEBUG:teuthology.orchestra.run.smithi114:> hostname
2023-11-01T03:03:42.069 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2023-11-01T03:03:42.070 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts
2023-11-01T03:03:42.126 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2023-11-01T03:03:42.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-11-01T03:03:42.269 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts
2023-11-01T03:03:42.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts
2023-11-01T03:03:42.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname
2023-11-01T03:03:42.441 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114
2023-11-01T03:03:42.509 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-11-01T03:03:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2023-11-01T03:03:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9"
2023-11-01T03:03:42.565 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2023-11-01T03:03:42.566 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:42.566 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9"
2023-11-01T03:03:42.566 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:42.566 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:42.567 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:42.567 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:42.567 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:42.567 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:42.567 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:42.568 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:42.568 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:42.568 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2023-11-01T03:03:42.569 DEBUG:teuthology.parallel:result is None
2023-11-01T03:03:44.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:44.679 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T03:03:44.679 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T03:03:45.028 INFO:teuthology.provision.fog.smithi190:Node is ready
2023-11-01T03:03:45.028 DEBUG:teuthology.orchestra.run.smithi190:> hostname
2023-11-01T03:03:45.043 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2023-11-01T03:03:45.044 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts
2023-11-01T03:03:45.098 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2023-11-01T03:03:45.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2023-11-01T03:03:45.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts
2023-11-01T03:03:45.224 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts
2023-11-01T03:03:45.292 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname
2023-11-01T03:03:45.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2023-11-01T03:03:45.427 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2023-11-01T03:03:45.481 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2023-11-01T03:03:45.481 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9"
2023-11-01T03:03:45.481 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2023-11-01T03:03:45.482 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:45.482 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9"
2023-11-01T03:03:45.482 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:45.482 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:45.482 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:45.483 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:45.483 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:45.483 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:45.483 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:45.483 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:45.484 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:45.484 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2023-11-01T03:03:45.485 DEBUG:teuthology.parallel:result is None
2023-11-01T03:03:47.890 WARNING:teuthology.provision.fog.smithi057:timed out
2023-11-01T03:03:53.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:54.141 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T03:03:54.141 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T03:03:54.469 INFO:teuthology.provision.fog.smithi057:Node is ready
2023-11-01T03:03:54.470 DEBUG:teuthology.orchestra.run.smithi057:> hostname
2023-11-01T03:03:54.485 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2023-11-01T03:03:54.486 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts
2023-11-01T03:03:54.542 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2023-11-01T03:03:54.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-11-01T03:03:54.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts
2023-11-01T03:03:54.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts
2023-11-01T03:03:54.744 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname
2023-11-01T03:03:54.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-11-01T03:03:54.885 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-11-01T03:03:54.940 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream"
2023-11-01T03:03:54.941 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9"
2023-11-01T03:03:54.941 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos"
2023-11-01T03:03:54.941 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:54.941 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9"
2023-11-01T03:03:54.941 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:54.942 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:54.942 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:54.942 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:54.942 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:54.942 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:54.943 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:54.943 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2023-11-01T03:03:54.944 DEBUG:teuthology.parallel:result is None
2023-11-01T03:03:55.207 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2023-11-01T03:03:55.208 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T03:03:55.236 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2023-11-01T03:03:55.236 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T03:03:55.253 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2023-11-01T03:03:55.253 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T03:03:55.269 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com
2023-11-01T03:03:55.270 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T03:03:55.287 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2023-11-01T03:03:55.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-11-01T03:03:55.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:55.384 DEBUG:teuthology.orchestra.run.smithi057:> true
2023-11-01T03:03:55.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-11-01T03:03:55.449 DEBUG:teuthology.orchestra.run.smithi057:> uname -m
2023-11-01T03:03:55.504 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2023-11-01T03:03:55.505 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-11-01T03:03:55.560 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream"
2023-11-01T03:03:55.560 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9"
2023-11-01T03:03:55.560 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos"
2023-11-01T03:03:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9"
2023-11-01T03:03:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:55.562 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:55.562 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:55.562 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:55.562 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:55.562 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:55.563 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:55.563 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-11-01T03:03:55.586 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2023-11-01T03:03:55.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-11-01T03:03:55.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:55.672 DEBUG:teuthology.orchestra.run.smithi114:> true
2023-11-01T03:03:55.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com'
2023-11-01T03:03:55.841 DEBUG:teuthology.orchestra.run.smithi114:> uname -m
2023-11-01T03:03:55.895 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2023-11-01T03:03:55.895 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release
2023-11-01T03:03:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream"
2023-11-01T03:03:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9"
2023-11-01T03:03:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2023-11-01T03:03:55.950 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9"
2023-11-01T03:03:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:55.951 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:55.952 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:55.953 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-11-01T03:03:55.978 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2023-11-01T03:03:55.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2023-11-01T03:03:55.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:56.064 DEBUG:teuthology.orchestra.run.smithi190:> true
2023-11-01T03:03:56.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com'
2023-11-01T03:03:56.233 DEBUG:teuthology.orchestra.run.smithi190:> uname -m
2023-11-01T03:03:56.287 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2023-11-01T03:03:56.288 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release
2023-11-01T03:03:56.342 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream"
2023-11-01T03:03:56.342 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9"
2023-11-01T03:03:56.343 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos"
2023-11-01T03:03:56.343 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:56.343 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9"
2023-11-01T03:03:56.343 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:56.343 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:56.344 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:56.344 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:56.344 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:56.344 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:56.344 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:56.345 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:56.345 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:56.345 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2023-11-01T03:03:56.361 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server
2023-11-01T03:03:56.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com'
2023-11-01T03:03:56.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T03:03:56.444 DEBUG:teuthology.orchestra.run.smithi195:> true
2023-11-01T03:03:56.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com'
2023-11-01T03:03:56.612 DEBUG:teuthology.orchestra.run.smithi195:> uname -m
2023-11-01T03:03:56.666 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64
2023-11-01T03:03:56.667 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release
2023-11-01T03:03:56.721 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream"
2023-11-01T03:03:56.722 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9"
2023-11-01T03:03:56.722 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos"
2023-11-01T03:03:56.722 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora"
2023-11-01T03:03:56.722 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9"
2023-11-01T03:03:56.723 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9"
2023-11-01T03:03:56.723 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T03:03:56.723 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2023-11-01T03:03:56.723 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon"
2023-11-01T03:03:56.723 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T03:03:56.724 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/"
2023-11-01T03:03:56.724 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T03:03:56.724 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T03:03:56.724 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T03:03:56.725 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-11-01T03:03:56.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:03:56.826 INFO:teuthology.dispatcher.supervisor:Running job 7442458
2023-11-01T03:03:56.826 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458 --name benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458/orig.config.yaml
2023-11-01T03:03:56.829 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458
2023-11-01T03:03:56.830 INFO:teuthology.dispatcher.supervisor:Job PID: 3798229
2023-11-01T03:03:56.830 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-01T03:05:56.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:07:56.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:09:56.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:11:57.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:13:57.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:15:57.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:17:57.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:19:57.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:21:57.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:23:57.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:25:57.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:27:57.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:29:57.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T03:29:57.716 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-01T03:29:57.863 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-01T03:29:57.864 INFO:teuthology.nuke:Checking targets against current locks
2023-11-01T03:29:57.913 DEBUG:teuthology.nuke:shortname: smithi057
2023-11-01T03:29:57.914 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T03:29:57.936 DEBUG:teuthology.nuke:shortname: smithi114
2023-11-01T03:29:57.937 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T03:29:57.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:58:48.431590', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFqeL3x2uVY7QMypf3dSTLEJ/D2psbA8VwY1npm2J6vh7yc1YSBEDiJ0jJHDCy2OcHLSJVnUXnaB+MhcEC0MM9k='}
2023-11-01T03:29:57.957 DEBUG:teuthology.nuke:shortname: smithi190
2023-11-01T03:29:57.957 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T03:29:57.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:58:48.427113', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB05tMhPvzF2WKfK8i83cuhF43B5ppfIZy4lcFseOJkvkIOuXY7TZTVIxmKISnkk+1P8GlAqnBpwm9vUL4QHKUQ='}
2023-11-01T03:29:57.970 DEBUG:teuthology.nuke:shortname: smithi195
2023-11-01T03:29:57.970 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T03:29:57.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:58:48.429148', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKOkT/NUn2xYgeUxiO1VIKoFcuD5GlfPmULhpaizyM8Lkig75jXIV6/kygmMRT270pL4+o+IFBLoR15ed9tqIM='}
2023-11-01T03:29:57.989 INFO:teuthology.orchestra.console.smithi057:Power off
2023-11-01T03:29:57.989 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T03:29:58.000 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:51:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 02:58:48.430398', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOtOSk1+RDVLpxn1E9388l/PQRvBDC0NHV3qRX+oezBEPHNX4L0D3SEqeaLGdqAmMQETxTmpiTK1KEiePR83nU0='}
2023-11-01T03:29:58.012 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-11-01T03:29:58.012 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T03:29:58.026 INFO:teuthology.orchestra.console.smithi114:Power off
2023-11-01T03:29:58.027 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T03:29:58.040 INFO:teuthology.orchestra.console.smithi190:Power off
2023-11-01T03:29:58.041 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T03:29:58.052 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-01T03:29:58.053 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off
2023-11-01T03:29:58.053 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T03:29:58.062 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2023-11-01T03:29:58.062 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T03:29:58.078 INFO:teuthology.orchestra.console.smithi195:Power off
2023-11-01T03:29:58.079 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T03:29:58.086 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off
2023-11-01T03:29:58.088 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-11-01T03:29:58.100 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off
2023-11-01T03:29:58.101 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T03:29:58.122 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off
2023-11-01T03:29:58.153 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-11-01T03:29:58.187 INFO:teuthology.orchestra.console.smithi114:Power off completed
2023-11-01T03:29:58.190 INFO:teuthology.orchestra.console.smithi190:Power off completed
2023-11-01T03:29:58.223 INFO:teuthology.orchestra.console.smithi195:Power off completed
2023-11-01T03:29:58.307 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2023-11-01T03:29:58.339 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com
2023-11-01T03:29:58.348 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com
2023-11-01T03:29:58.372 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com