2023-08-15T23:22:50.516 INFO:root:teuthology version: 0.0.1.dev183+g5435569
2023-08-15T23:22:50.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:22:50.701 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f231bc1fd00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f231bc9ee50>, signals=[15])
2023-08-15T23:22:50.704 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging
2023-08-15T23:22:50.704 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server
2023-08-15T23:22:50.705 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2023-08-15T23:22:50.732 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-08-15T23:22:50.733 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-08-15T23:22:50.733 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-08-15T23:22:50.735 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"}
2023-08-15T23:22:50.774 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-08-15T23:22:50.775 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-08-15T23:22:50.775 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-08-15T23:22:50.777 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"}
2023-08-15T23:22:50.799 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"}
2023-08-15T23:22:50.821 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-15T23:22:50.847 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-15T23:22:50.863 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-15T23:22:50.864 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 7}
2023-08-15T23:22:50.872 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-08-15T23:22:50.886 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-15T23:22:50.887 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 7}
2023-08-15T23:22:50.908 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of rhel 8.4
2023-08-15T23:22:50.908 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:22:50.911 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.4 (ID 7)
2023-08-15T23:22:50.911 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 7}
2023-08-15T23:22:50.939 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.4
2023-08-15T23:22:50.940 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:22:55.947 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"}
2023-08-15T23:22:55.948 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.4
2023-08-15T23:22:55.949 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-08-15T23:23:16.004 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1}
2023-08-15T23:23:21.010 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"}
2023-08-15T23:23:21.012 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"}
2023-08-15T23:23:31.058 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1}
2023-08-15T23:23:31.061 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1}
2023-08-15T23:23:31.076 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:23:31.115 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-08-15T23:23:31.122 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:23:33.280 INFO:teuthology.orchestra.console.smithi138:Power off
2023-08-15T23:23:33.282 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:23:33.300 INFO:teuthology.orchestra.console.smithi159:Power off
2023-08-15T23:23:33.301 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:23:33.315 INFO:teuthology.orchestra.console.smithi060:Power off
2023-08-15T23:23:33.316 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:23:33.326 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-08-15T23:23:33.327 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:33.339 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-08-15T23:23:33.340 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:33.351 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off
2023-08-15T23:23:33.352 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:33.360 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-08-15T23:23:33.363 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-15T23:23:33.374 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2023-08-15T23:23:33.462 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-08-15T23:23:33.467 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-08-15T23:23:33.475 INFO:teuthology.orchestra.console.smithi060:Power off completed
2023-08-15T23:23:33.567 INFO:teuthology.orchestra.console.smithi159:Power on
2023-08-15T23:23:33.568 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-15T23:23:33.577 INFO:teuthology.orchestra.console.smithi138:Power on
2023-08-15T23:23:33.578 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-15T23:23:33.588 INFO:teuthology.orchestra.console.smithi060:Power on
2023-08-15T23:23:33.588 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-15T23:23:33.600 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On
2023-08-15T23:23:33.602 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:33.611 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2023-08-15T23:23:33.611 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:33.624 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-15T23:23:33.633 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-08-15T23:23:33.636 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On
2023-08-15T23:23:33.636 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:33.681 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2023-08-15T23:23:37.628 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:37.637 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:37.683 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:37.739 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-15T23:23:37.746 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-08-15T23:23:37.794 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2023-08-15T23:23:41.744 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:41.752 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:41.796 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:42.855 DEBUG:teuthology.orchestra.console.smithi138:check power output: 
2023-08-15T23:23:42.863 DEBUG:teuthology.orchestra.console.smithi159:check power output: 
2023-08-15T23:23:42.905 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:23:46.857 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:46.866 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:46.906 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:46.967 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-08-15T23:23:47.069 INFO:teuthology.orchestra.console.smithi138:Power on completed
2023-08-15T23:23:47.170 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-08-15T23:23:47.171 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:23:51.248 DEBUG:teuthology.orchestra.console.smithi159:check power output: 
2023-08-15T23:23:51.248 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:23:55.252 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:55.260 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:23:56.362 DEBUG:teuthology.orchestra.console.smithi159:check power output: 
2023-08-15T23:23:56.368 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:24:00.363 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:00.372 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:01.475 DEBUG:teuthology.orchestra.console.smithi159:check power output: 
2023-08-15T23:24:01.481 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:24:05.476 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:05.485 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:06.310 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:24:06.589 DEBUG:teuthology.orchestra.console.smithi159:check power output: 
2023-08-15T23:24:06.596 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:24:10.591 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:10.599 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:10.701 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-08-15T23:24:10.803 INFO:teuthology.orchestra.console.smithi159:Power on completed
2023-08-15T23:24:10.903 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-08-15T23:24:10.904 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-08-15T23:24:14.997 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:24:15.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:24:18.132 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-08-15T23:24:18.999 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:20.110 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:24:21.377 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:24:26.386 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:24:26.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:24:32.025 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on
2023-08-15T23:24:32.126 INFO:teuthology.orchestra.console.smithi060:Power on completed
2023-08-15T23:24:32.227 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2023-08-15T23:24:32.227 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:24:34.480 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-08-15T23:24:40.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:24:46.467 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:24:47.902 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:24:48.564 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-08-15T23:24:54.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:25:03.065 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:25:03.066 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:25:28.191 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:25:28.205 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:25:43.280 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:25:43.282 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:25:59.588 WARNING:teuthology.provision.fog.smithi159:timed out
2023-08-15T23:25:59.699 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:26:04.705 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:26:09.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:26:24.777 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:26:24.778 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:26:33.549 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: Authentication failed.
2023-08-15T23:26:33.551 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-15T23:26:33.552 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-15T23:26:33.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:34.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:35.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:36.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:37.568 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:38.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:39.576 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:40.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:41.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:42.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:43.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:44.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:45.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:46.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:47.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:48.556 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:26:53.559 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:26:58.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:58.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:26:59.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:00.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:01.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:02.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:03.688 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:04.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:05.696 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:06.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:07.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:08.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:09.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:10.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:11.719 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:12.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:13.625 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:27:18.633 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-08-15T23:27:23.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:23.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:27:28.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:29.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:30.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:31.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:31.764 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-08-15T23:27:32.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:33.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:34.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:35.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:36.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:37.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:37.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:27:42.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:43.703 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-15T23:27:43.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:43.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:27:44.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:45.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:45.840 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-08-15T23:27:46.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:46.836 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:27:47.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:48.799 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:49.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:50.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:51.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:51.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:27:52.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:52.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:27:53.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:54.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:54.896 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-08-15T23:27:55.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:55.888 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:27:56.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:57.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:58.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:27:59.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:00.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:00.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:28:05.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:28:05.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:06.909 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:07.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:08.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:08.976 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:28:09.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:10.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:11.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:12.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:13.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:14.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-08-15T23:28:14.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:28:23.056 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:28:29.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:28:37.136 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:28:43.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:29:05.901 WARNING:teuthology.provision.fog.smithi060:timed out
2023-08-15T23:29:06.676 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:29:11.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:29:16.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:29:22.158 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-15T23:29:22.159 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-15T23:29:22.416 INFO:teuthology.provision.fog.smithi060:Node is ready
2023-08-15T23:29:22.417 DEBUG:teuthology.orchestra.run.smithi060:> hostname
2023-08-15T23:29:22.473 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2023-08-15T23:29:22.474 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts
2023-08-15T23:29:22.530 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2023-08-15T23:29:22.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2023-08-15T23:29:22.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts
2023-08-15T23:29:22.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts
2023-08-15T23:29:22.741 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname
2023-08-15T23:29:22.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2023-08-15T23:29:22.871 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2023-08-15T23:29:22.925 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Red Hat Enterprise Linux"
2023-08-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="8.4 (Ootpa)"
2023-08-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:ID="rhel"
2023-08-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="fedora"
2023-08-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="8.4"
2023-08-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el8"
2023-08-15T23:29:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.redhat.com/"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-15T23:29:22.927 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-15T23:29:22.928 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-15T23:29:22.928 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2023-08-15T23:29:22.930 DEBUG:teuthology.parallel:result is None
2023-08-15T23:29:24.976 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-15T23:29:30.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:29:33.013 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-15T23:29:33.014 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-15T23:29:48.671 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-08-15T23:29:48.671 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-08-15T23:29:48.687 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2023-08-15T23:29:48.687 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts
2023-08-15T23:29:48.741 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-08-15T23:29:48.742 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-08-15T23:29:48.897 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts
2023-08-15T23:29:48.921 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-08-15T23:29:48.985 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname
2023-08-15T23:29:49.048 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-08-15T23:29:49.112 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-08-15T23:29:49.166 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux"
2023-08-15T23:29:49.166 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.4 (Ootpa)"
2023-08-15T23:29:49.166 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel"
2023-08-15T23:29:49.166 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora"
2023-08-15T23:29:49.167 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.4"
2023-08-15T23:29:49.167 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-08-15T23:29:49.167 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-08-15T23:29:49.167 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-08-15T23:29:49.167 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-08-15T23:29:49.167 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/"
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-15T23:29:49.168 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-08-15T23:29:49.169 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-08-15T23:29:49.169 DEBUG:teuthology.parallel:result is None
2023-08-15T23:30:33.712 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-08-15T23:30:33.713 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi159
2023-08-15T23:30:42.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-08-15T23:30:42.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-15T23:30:47.766 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-08-15T23:30:47.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-08-15T23:30:47.885 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-15T23:30:47.886 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-15T23:30:47.891 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-08-15T23:30:47.891 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-08-15T23:30:47.896 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-08-15T23:30:47.896 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-08-15T23:30:47.903 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-08-15T23:30:47.903 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-08-15T23:30:47.965 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-08-15T23:30:47.980 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-08-15T23:30:47.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-08-15T23:30:48.004 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-08-15T23:30:48.018 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-08-15T23:30:48.071 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu"
2023-08-15T23:30:48.072 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-08-15T23:30:48.072 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu
2023-08-15T23:30:48.072 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian
2023-08-15T23:30:48.072 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-08-15T23:30:48.072 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="20.04"
2023-08-15T23:30:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/"
2023-08-15T23:30:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-08-15T23:30:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-08-15T23:30:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-08-15T23:30:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=focal
2023-08-15T23:30:48.073 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=focal
2023-08-15T23:30:48.075 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi159's OS to be rhel 8.4 but found ubuntu 20.04
2023-08-15T23:30:48.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-15T23:30:53.216 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f09f1e036eb940468ce882bc3581345f
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi159's OS to be rhel 8.4 but found ubuntu 20.04
2023-08-15T23:30:53.218 INFO:teuthology.nuke:Checking targets against current locks
2023-08-15T23:30:56.878 DEBUG:teuthology.nuke:shortname: smithi060
2023-08-15T23:30:56.879 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-15T23:30:56.902 DEBUG:teuthology.nuke:shortname: smithi138
2023-08-15T23:30:56.902 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-15T23:30:56.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 23:22:49.664726', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCekkoVXdOVeHAGJG01U2i9EQpR74GVGuufPKqV8DKess8F4VNchsSrGgHd34QIe1DFra76s2VWdoRQcS3vu1YFAjd0IFBXttl7upvewUoDnCfsWlSIrkrwVWiLNVq+jB8P81Py8eCFjEfkZuatmt0/NfRsUX9y3NddaqEwzmd31WAmdVzeN8XCs4kTYoH4lhkbZ2elf9KNlTK3HJIToC7RMyOUslcaXhwZBVgPA16Qd6XHp+wpy8U0GxgC432nPASUWh4VIamPNTVVbTVxQOYXGHWrZSEXirD4aLiGPwCuLnMRxoBg2r3UiFk8MI3jd8XsuEqC9unm81sonE3kNVoy5aXGj7xwT4OcgF0LMvsIUn5FzkMMa2DuUFhFxXlMBtm/SVdQ0YY8LfnFdQxN96DKxhAcZq4lhZNvR9FrBgISkuusEU5jLa2+Uc5NRt+FOP5d/jHG/EJvLK4w6Wz6KpCPPONgpD8JP8eRdwM+5kjPoWTpuWCuJE4K2SFwiyGjmUM='}
2023-08-15T23:30:56.919 DEBUG:teuthology.nuke:shortname: smithi159
2023-08-15T23:30:56.920 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-15T23:30:56.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 23:22:49.667956', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfLbwjpr7T/hhQdYJB4qaF3EfF4yiO4fysGslRk43ShsXWXLrY/PzL4lOD6cF31BhfA224RbAuE8lCX3SmqhFdrpkrtxeqHXXrZPCwxWDIKo22a5IgZ+mow54Z9v3m5dw+kQBNDYEQJXE9OFQwUgZojUHojmbLRUg3BTV0tGiSTg9MFPA8NFjJ+GTsSoc54Tayj/0CascFr8PFmVEGkmOBpMciHTl8lpRxlwCl4ZG0yMr8o3kVge0+9mALZf5rZi4x4z/S0OaAQOnx3zkwy8LagC4I6JSXQDkpObaEzR/N0+2/Ch/Tp5FZ9i3nFBb4DTr0y+w0JPuiEsgwNv1dTe93D8s5XGJCCjKp7rkcY6GkHmUTBjVHJjaGRBBOq6v6BdfEWaoMR3Kjx9rvOlmnTxnic+kvcqKtETYdYDAZR7OcYMd9ZpJo5ZEBgErcjV3ca30JnWoF7GqsjTuiDRXfCvyHkLYa6nuHzDmFcaMmQHOQNx9Unb9AFPNVPc9DLJbTlN8='}
2023-08-15T23:30:56.941 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_17:00:18-rbd-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368998', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 23:22:50.403067', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-08-15T23:30:56.949 INFO:teuthology.orchestra.console.smithi060:Power off
2023-08-15T23:30:56.950 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:30:56.972 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off
2023-08-15T23:30:56.973 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:30:56.992 INFO:teuthology.orchestra.console.smithi138:Power off
2023-08-15T23:30:56.993 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:30:57.004 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on
2023-08-15T23:30:57.016 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-08-15T23:30:57.017 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:30:57.033 INFO:teuthology.orchestra.console.smithi159:Power off
2023-08-15T23:30:57.034 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-15T23:30:57.043 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-08-15T23:30:57.056 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-08-15T23:30:57.057 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:30:57.080 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-08-15T23:31:01.005 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:01.045 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:01.081 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:01.116 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on
2023-08-15T23:31:01.154 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-08-15T23:31:01.192 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-08-15T23:31:05.117 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:05.155 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:05.193 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:06.228 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:06.266 DEBUG:teuthology.orchestra.console.smithi138:check power output: 
2023-08-15T23:31:06.302 DEBUG:teuthology.orchestra.console.smithi159:check power output: 
2023-08-15T23:31:10.229 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:10.267 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:10.303 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:10.414 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-08-15T23:31:10.516 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-08-15T23:31:10.660 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com
2023-08-15T23:31:11.338 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:11.377 DEBUG:teuthology.orchestra.console.smithi138:check power output: 
2023-08-15T23:31:15.339 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:15.378 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:15.490 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-15T23:31:15.592 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-08-15T23:31:20.703 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:25.732 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:25.770 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com
2023-08-15T23:31:26.842 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:30.844 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:31.954 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:35.955 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:37.065 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:41.066 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:42.176 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:46.177 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:47.287 DEBUG:teuthology.orchestra.console.smithi060:check power output: 
2023-08-15T23:31:51.290 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-15T23:31:51.401 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off
2023-08-15T23:31:51.502 INFO:teuthology.orchestra.console.smithi060:Power off completed
2023-08-15T23:32:01.662 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com
2023-08-15T23:32:06.985 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi159's OS to be rhel 8.4 but found ubuntu 20.04