2023-11-09T16:48:18.852 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T16:48:18.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T16:48:19.040 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f54c1c56ac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f54c275d670>, signals=[15])
2023-11-09T16:48:19.041 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-11-09T16:48:19.041 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T16:48:19.041 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-09T16:48:19.066 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2023-11-09T16:48:19.066 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T16:48:19.066 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-11-09T16:48:19.067 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"}
2023-11-09T16:48:19.091 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging
2023-11-09T16:48:19.091 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T16:48:19.091 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-11-09T16:48:19.092 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"}
2023-11-09T16:48:19.107 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"}
2023-11-09T16:48:19.148 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-09T16:48:19.162 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-09T16:48:19.172 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-09T16:48:19.191 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-09T16:48:19.191 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 5}
2023-11-09T16:48:19.217 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-09T16:48:19.217 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 5}
2023-11-09T16:48:19.220 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-09T16:48:19.220 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 5}
2023-11-09T16:48:19.254 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6
2023-11-09T16:48:19.254 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:48:19.274 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.6
2023-11-09T16:48:19.275 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:48:19.278 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of rhel 8.6
2023-11-09T16:48:19.278 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:48:19.354 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T16:48:19.383 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T16:48:19.401 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T16:48:19.412 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1}
2023-11-09T16:48:19.466 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1}
2023-11-09T16:48:19.475 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1}
2023-11-09T16:48:19.487 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:48:19.613 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:48:19.841 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:48:19.869 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-09T16:48:19.870 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T16:48:19.890 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-09T16:48:19.891 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:19.913 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T16:48:19.940 INFO:teuthology.orchestra.console.smithi158:Power off
2023-11-09T16:48:19.940 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T16:48:19.960 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off
2023-11-09T16:48:19.961 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:19.981 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-11-09T16:48:19.995 INFO:teuthology.orchestra.console.smithi104:Power off
2023-11-09T16:48:19.996 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T16:48:20.020 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-11-09T16:48:20.021 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:20.042 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-09T16:48:23.914 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:23.983 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:24.022 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T16:48:24.043 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:24.091 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-11-09T16:48:24.151 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-09T16:48:28.028 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:28.092 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:28.139 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T16:48:28.152 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:28.203 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-11-09T16:48:28.240 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-09T16:48:28.262 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T16:48:28.305 INFO:teuthology.orchestra.console.smithi158:Power off completed
2023-11-09T16:48:28.341 INFO:teuthology.orchestra.console.smithi081:Power on
2023-11-09T16:48:28.342 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T16:48:28.364 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-11-09T16:48:28.367 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2023-11-09T16:48:28.368 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:28.390 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T16:48:28.405 INFO:teuthology.orchestra.console.smithi158:Power on
2023-11-09T16:48:28.406 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T16:48:28.428 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On
2023-11-09T16:48:28.429 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:28.450 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-11-09T16:48:28.466 INFO:teuthology.orchestra.console.smithi104:Power on
2023-11-09T16:48:28.466 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T16:48:28.487 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2023-11-09T16:48:28.488 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:28.510 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T16:48:32.395 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:32.451 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:32.504 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2023-11-09T16:48:32.511 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:32.560 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-11-09T16:48:32.605 INFO:teuthology.orchestra.console.smithi081:Power on completed
2023-11-09T16:48:32.618 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T16:48:32.707 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-11-09T16:48:32.707 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:48:36.562 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:36.620 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T16:48:36.672 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-11-09T16:48:36.773 INFO:teuthology.orchestra.console.smithi158:Power on completed
2023-11-09T16:48:36.820 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-09T16:48:36.874 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish
2023-11-09T16:48:36.875 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:48:36.921 INFO:teuthology.orchestra.console.smithi104:Power on completed
2023-11-09T16:48:37.023 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2023-11-09T16:48:37.023 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:48:47.821 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:48:51.981 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:48:52.113 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:49:02.947 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:49:07.074 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:49:07.209 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:49:18.059 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:49:22.166 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:49:22.309 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:49:33.188 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:49:37.272 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:49:37.397 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:49:48.286 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:49:52.383 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:49:52.483 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:50:03.406 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:50:07.499 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:50:07.563 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:50:18.510 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:50:22.622 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:50:22.681 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:50:33.650 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:50:37.778 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:50:37.853 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:50:48.769 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:50:52.899 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:50:52.962 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:51:03.891 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:51:08.040 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:51:08.066 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-09T16:51:08.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:51:08.443 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-09T16:51:18.987 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:51:23.136 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:51:34.075 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:51:38.203 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:51:49.143 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:51:53.265 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:52:04.210 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-11-09T16:52:04.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:07.323 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:52:08.335 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-11-09T16:52:08.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:11.451 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:52:12.448 WARNING:teuthology.provision.fog.smithi104:timed out
2023-11-09T16:52:13.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:16.378 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:52:17.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:18.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:20.506 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:52:22.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:25.434 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:52:26.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:29.562 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:52:31.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:34.490 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:52:35.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:36.858 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-09T16:52:38.618 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:52:40.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:42.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:43.550 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:52:44.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:45.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T16:52:45.385 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T16:52:45.704 INFO:teuthology.provision.fog.smithi104:Node is ready
2023-11-09T16:52:45.704 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2023-11-09T16:52:45.720 INFO:teuthology.orchestra.run.smithi104.stdout:smithi022
2023-11-09T16:52:45.720 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi022 /etc/hosts
2023-11-09T16:52:45.775 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-09T16:52:45.776 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-11-09T16:52:45.880 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi022/smithi104/g' /etc/hosts
2023-11-09T16:52:45.906 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.22/172.21.15.104/g' /etc/hosts
2023-11-09T16:52:45.973 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi022/smithi104/g' /etc/hostname
2023-11-09T16:52:46.038 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-11-09T16:52:46.105 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-11-09T16:52:46.161 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T16:52:46.161 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T16:52:46.161 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel"
2023-11-09T16:52:46.161 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora"
2023-11-09T16:52:46.162 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6"
2023-11-09T16:52:46.162 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2023-11-09T16:52:46.162 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T16:52:46.162 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2023-11-09T16:52:46.162 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T16:52:46.163 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T16:52:46.163 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T16:52:46.163 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T16:52:46.163 INFO:teuthology.orchestra.run.smithi104.stdout:
2023-11-09T16:52:46.163 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T16:52:46.163 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T16:52:46.164 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T16:52:46.164 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T16:52:46.164 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2023-11-09T16:52:46.165 DEBUG:teuthology.parallel:result is None
2023-11-09T16:52:47.674 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:52:49.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:52.634 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:52:53.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:52:56.730 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:52:58.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:02.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:05.786 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:53:11.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:14.842 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-11-09T16:53:17.050 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:53:20.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:23.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:26.106 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:53:32.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:35.162 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-11-09T16:53:41.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:53:41.405 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T16:53:41.406 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T16:53:41.689 INFO:teuthology.provision.fog.smithi081:Node is ready
2023-11-09T16:53:41.689 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2023-11-09T16:53:41.707 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2023-11-09T16:53:41.708 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2023-11-09T16:53:41.765 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2023-11-09T16:53:41.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-09T16:53:41.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2023-11-09T16:53:41.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2023-11-09T16:53:41.975 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2023-11-09T16:53:42.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2023-11-09T16:53:42.108 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-09T16:53:42.164 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T16:53:42.165 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T16:53:42.165 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-09T16:53:42.165 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-09T16:53:42.165 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-11-09T16:53:42.165 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-09T16:53:42.166 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T16:53:42.166 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-09T16:53:42.166 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T16:53:42.166 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T16:53:42.166 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T16:53:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T16:53:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-09T16:53:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T16:53:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T16:53:42.167 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T16:53:42.168 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T16:53:42.168 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2023-11-09T16:53:42.168 DEBUG:teuthology.parallel:result is None
2023-11-09T16:54:20.846 WARNING:teuthology.provision.fog.smithi158:timed out
2023-11-09T16:54:26.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:54:26.918 ERROR:paramiko.transport:Unknown exception: The socket has already been closed by another greenlet
2023-11-09T16:54:26.920 ERROR:paramiko.transport:Traceback (most recent call last):
2023-11-09T16:54:26.920 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2110, in run
2023-11-09T16:54:26.920 ERROR:paramiko.transport:    ptype, m = self.packetizer.read_message()
2023-11-09T16:54:26.920 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
2023-11-09T16:54:26.921 ERROR:paramiko.transport:    header = self.read_all(self.__block_size_in, check_rekey=True)
2023-11-09T16:54:26.921 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
2023-11-09T16:54:26.921 ERROR:paramiko.transport:    x = self.__socket.recv(n)
2023-11-09T16:54:26.922 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 663, in recv
2023-11-09T16:54:26.922 ERROR:paramiko.transport:    self._wait(self._read_event)
2023-11-09T16:54:26.922 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 317, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-11-09T16:54:26.923 ERROR:paramiko.transport:  File "src/gevent/_hub_primitives.py", line 321, in gevent._gevent_c_hub_primitives.wait_on_socket
2023-11-09T16:54:26.923 ERROR:paramiko.transport:gevent.exceptions.ConcurrentObjectUseError: The socket has already been closed by another greenlet
2023-11-09T16:54:26.923 ERROR:paramiko.transport:
2023-11-09T16:54:27.185 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T16:54:27.185 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T16:54:27.491 INFO:teuthology.provision.fog.smithi158:Node is ready
2023-11-09T16:54:27.491 DEBUG:teuthology.orchestra.run.smithi158:> hostname
2023-11-09T16:54:27.510 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158
2023-11-09T16:54:27.511 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158 /etc/hosts
2023-11-09T16:54:27.568 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158
2023-11-09T16:54:27.569 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-11-09T16:54:27.698 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hosts
2023-11-09T16:54:27.727 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts
2023-11-09T16:54:27.796 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158/smithi158/g' /etc/hostname
2023-11-09T16:54:27.863 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-11-09T16:54:27.930 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-11-09T16:54:27.987 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T16:54:27.987 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T16:54:27.987 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel"
2023-11-09T16:54:27.987 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora"
2023-11-09T16:54:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6"
2023-11-09T16:54:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8"
2023-11-09T16:54:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T16:54:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31"
2023-11-09T16:54:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T16:54:27.988 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T16:54:27.989 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T16:54:27.989 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T16:54:27.989 INFO:teuthology.orchestra.run.smithi158.stdout:
2023-11-09T16:54:27.989 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T16:54:27.989 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T16:54:27.990 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T16:54:27.990 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T16:54:27.990 INFO:teuthology.provision.fog.smithi158:Deploy complete!
2023-11-09T16:54:27.991 DEBUG:teuthology.parallel:result is None
2023-11-09T16:54:28.173 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2023-11-09T16:54:28.174 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T16:54:28.199 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2023-11-09T16:54:28.200 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com
2023-11-09T16:54:28.201 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2023-11-09T16:54:28.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-09T16:54:28.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:54:28.269 DEBUG:teuthology.orchestra.run.smithi081:> true
2023-11-09T16:54:28.338 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2023-11-09T16:54:28.338 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2023-11-09T16:54:28.397 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2023-11-09T16:54:28.398 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2023-11-09T16:54:28.456 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T16:54:28.456 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T16:54:28.457 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel"
2023-11-09T16:54:28.457 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora"
2023-11-09T16:54:28.457 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6"
2023-11-09T16:54:28.457 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2023-11-09T16:54:28.458 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T16:54:28.458 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2023-11-09T16:54:28.458 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T16:54:28.458 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T16:54:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T16:54:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T16:54:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:
2023-11-09T16:54:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T16:54:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T16:54:28.459 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T16:54:28.460 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T16:54:28.461 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-11-09T16:54:28.483 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2023-11-09T16:54:28.483 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-11-09T16:54:28.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:54:28.552 DEBUG:teuthology.orchestra.run.smithi104:> true
2023-11-09T16:54:28.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-11-09T16:54:28.688 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2023-11-09T16:54:28.744 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2023-11-09T16:54:28.745 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-11-09T16:54:28.801 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T16:54:28.802 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T16:54:28.802 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel"
2023-11-09T16:54:28.802 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora"
2023-11-09T16:54:28.802 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6"
2023-11-09T16:54:28.803 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8"
2023-11-09T16:54:28.803 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T16:54:28.803 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2023-11-09T16:54:28.803 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T16:54:28.803 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T16:54:28.803 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T16:54:28.804 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T16:54:28.804 INFO:teuthology.orchestra.run.smithi104.stdout:
2023-11-09T16:54:28.804 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T16:54:28.804 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T16:54:28.805 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T16:54:28.805 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T16:54:28.805 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-11-09T16:54:28.832 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server
2023-11-09T16:54:28.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com'
2023-11-09T16:54:28.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T16:54:28.897 DEBUG:teuthology.orchestra.run.smithi158:> true
2023-11-09T16:54:28.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com'
2023-11-09T16:54:28.964 DEBUG:teuthology.orchestra.run.smithi158:> uname -m
2023-11-09T16:54:29.022 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64
2023-11-09T16:54:29.022 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-11-09T16:54:29.080 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Red Hat Enterprise Linux"
2023-11-09T16:54:29.080 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8.6 (Ootpa)"
2023-11-09T16:54:29.080 INFO:teuthology.orchestra.run.smithi158.stdout:ID="rhel"
2023-11-09T16:54:29.080 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="fedora"
2023-11-09T16:54:29.081 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8.6"
2023-11-09T16:54:29.081 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8"
2023-11-09T16:54:29.081 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-09T16:54:29.081 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31"
2023-11-09T16:54:29.081 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-09T16:54:29.082 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.redhat.com/"
2023-11-09T16:54:29.082 INFO:teuthology.orchestra.run.smithi158.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-09T16:54:29.082 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T16:54:29.083 INFO:teuthology.orchestra.run.smithi158.stdout:
2023-11-09T16:54:29.083 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T16:54:29.083 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-09T16:54:29.084 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-09T16:54:29.084 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-09T16:54:29.085 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-11-09T16:54:29.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T16:54:29.208 INFO:teuthology.dispatcher.supervisor:Running job 7452990
2023-11-09T16:54:29.208 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi/7452990 --name mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi/7452990/orig.config.yaml
2023-11-09T16:54:29.212 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi/7452990
2023-11-09T16:54:29.213 INFO:teuthology.dispatcher.supervisor:Job PID: 1955529
2023-11-09T16:54:29.213 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T16:56:29.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T16:58:29.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:00:29.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:02:29.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:04:29.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:06:29.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:08:29.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:10:29.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:12:29.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:14:29.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:16:29.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:18:29.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T17:18:30.062 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T17:18:30.191 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T17:18:30.192 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T17:18:30.242 DEBUG:teuthology.nuke:shortname: smithi081
2023-11-09T17:18:30.243 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T17:18:30.265 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi/7452990', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 16:48:16.807814', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-09T17:18:30.274 DEBUG:teuthology.nuke:shortname: smithi104
2023-11-09T17:18:30.274 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T17:18:30.283 DEBUG:teuthology.nuke:shortname: smithi158
2023-11-09T17:18:30.284 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T17:18:30.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi/7452990', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 16:48:16.805213', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-09T17:18:30.310 INFO:teuthology.orchestra.console.smithi081:Power off
2023-11-09T17:18:30.310 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T17:18:30.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_16:46:30-fs:workload-main-distro-default-smithi/7452990', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 16:48:16.806616', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-09T17:18:30.331 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2023-11-09T17:18:30.331 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T17:18:30.350 INFO:teuthology.orchestra.console.smithi104:Power off
2023-11-09T17:18:30.350 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T17:18:30.357 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2023-11-09T17:18:30.370 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-11-09T17:18:30.371 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T17:18:30.382 INFO:teuthology.orchestra.console.smithi158:Power off
2023-11-09T17:18:30.382 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T17:18:30.390 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-09T17:18:30.404 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off
2023-11-09T17:18:30.404 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T17:18:30.424 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-11-09T17:18:30.459 INFO:teuthology.orchestra.console.smithi081:Power off completed
2023-11-09T17:18:30.491 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-11-09T17:18:30.525 INFO:teuthology.orchestra.console.smithi158:Power off completed
2023-11-09T17:18:30.608 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-11-09T17:18:30.634 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com
2023-11-09T17:18:30.667 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com