2023-08-15T22:49:57.164 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T22:49:57.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:50:11.710 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee23952ee0>, signals=[15]) 2023-08-15T22:50:11.713 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-08-15T22:50:11.713 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:50:11.714 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-15T22:50:11.733 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-08-15T22:50:11.734 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:50:11.734 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-15T22:50:11.735 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-08-15T22:50:11.758 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-08-15T22:50:11.820 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:50:11.838 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:50:11.869 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:50:11.870 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 7} 2023-08-15T22:50:16.877 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:50:16.878 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 7} 2023-08-15T22:50:21.934 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.4 2023-08-15T22:50:21.934 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-15T22:50:26.942 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.4 2023-08-15T22:50:26.942 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:50:31.991 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:50:36.966 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:50:37.021 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-08-15T22:50:37.023 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-08-15T22:50:37.081 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-15T22:50:37.083 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:50:46.525 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-15T22:50:46.526 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:50:46.540 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-15T22:50:46.541 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:50:46.552 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-15T22:50:46.553 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:50:46.564 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-15T22:50:46.565 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:50:46.574 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-15T22:50:46.586 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-15T22:50:46.676 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-15T22:50:46.687 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-15T22:50:46.777 INFO:teuthology.orchestra.console.smithi178:Power on 2023-08-15T22:50:46.777 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:50:46.789 INFO:teuthology.orchestra.console.smithi022:Power on 2023-08-15T22:50:46.789 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:50:51.804 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2023-08-15T22:50:51.805 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:50:51.815 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-08-15T22:50:51.815 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:50:51.826 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-15T22:50:52.826 DEBUG:teuthology.orchestra.console.smithi022:check power output: 2023-08-15T22:50:55.828 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:50:56.827 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:50:56.939 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-08-15T22:50:56.940 DEBUG:teuthology.orchestra.console.smithi178:check power output: 2023-08-15T22:50:57.041 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-08-15T22:50:57.141 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-08-15T22:50:57.142 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-08-15T22:51:02.149 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:51:02.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:51:08.218 DEBUG:teuthology.orchestra.console.smithi178:check power output: 2023-08-15T22:51:10.288 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-15T22:51:12.219 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:51:13.330 DEBUG:teuthology.orchestra.console.smithi178:check power output: 2023-08-15T22:51:16.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:51:21.297 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:51:22.408 DEBUG:teuthology.orchestra.console.smithi178:check power output: 2023-08-15T22:51:24.368 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-15T22:51:26.410 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:51:26.521 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-15T22:51:26.622 INFO:teuthology.orchestra.console.smithi178:Power on completed 2023-08-15T22:51:26.723 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-08-15T22:51:26.723 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:51:30.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:51:38.448 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-15T22:51:41.796 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:51:44.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:51:52.532 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-08-15T22:51:56.850 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:52:01.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:52:21.920 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:52:38.459 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: Authentication failed. 2023-08-15T22:52:38.461 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:52:38.461 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:52:38.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:39.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:40.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:41.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:41.980 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:52:42.576 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:43.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:44.587 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:45.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:46.597 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:47.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:48.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:49.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:50.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:51.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:52.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:53.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:54.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:55.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:56.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:52:57.630 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-15T22:53:01.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:01.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:53:01.435 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: Authentication failed. 2023-08-15T22:53:01.436 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:53:01.436 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:53:01.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:02.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:02.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:03.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:03.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:04.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:04.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:05.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:05.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:06.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:06.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:07.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:07.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:08.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:08.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:09.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:09.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:10.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:10.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:11.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:11.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:12.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:12.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:13.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:13.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:14.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:14.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:15.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:15.559 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:16.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:16.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:17.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:17.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:18.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:18.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:19.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:19.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:20.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:20.602 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:21.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:21.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:22.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:22.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:23.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:23.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:24.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:24.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:25.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:25.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:26.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:26.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:27.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:27.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:28.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:28.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:29.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:29.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:30.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:30.693 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:31.569 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:31.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:32.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:32.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:33.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:33.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:34.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:34.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:35.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:35.732 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:36.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:36.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:37.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:37.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:38.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:38.756 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:39.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:39.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:40.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:40.772 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:41.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:41.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:42.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:42.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:43.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:43.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:44.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:44.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:45.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:45.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:46.691 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:46.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:47.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:47.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:48.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:48.840 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:49.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:49.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:50.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:50.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:51.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:51.865 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:52.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:52.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:53.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:53.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:54.760 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:54.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:55.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:55.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:56.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:56.909 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:57.787 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:57.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:58.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:58.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:59.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:53:59.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:00.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:00.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:01.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:01.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:02.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:02.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:03.838 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:03.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:04.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:04.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:05.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:05.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:06.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:06.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:07.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:08.002 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:08.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:09.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:09.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:10.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:10.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:11.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:11.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:12.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:12.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:13.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:13.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:14.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:14.932 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:15.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:15.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:16.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:16.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:17.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:17.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:18.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:18.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:19.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:19.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:20.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:20.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:21.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:21.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:22.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:23.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:23.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:24.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:24.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:25.144 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:26.153 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:27.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:28.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:29.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:30.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:31.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:32.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:33.214 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:34.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:35.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:36.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:37.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:38.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:39.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:40.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:41.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:42.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:43.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:44.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:45.318 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:46.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:54:47.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:56:11.376 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-15T22:56:11.378 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi022 2023-08-15T22:56:20.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-15T22:56:20.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:56:25.649 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-08-15T22:56:25.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-15T22:56:25.920 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:56:25.920 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:56:25.975 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-08-15T22:56:25.976 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-08-15T22:56:26.031 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-08-15T22:56:26.032 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-08-15T22:56:26.087 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-08-15T22:56:26.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-15T22:56:26.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-08-15T22:56:26.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-08-15T22:56:26.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-08-15T22:56:26.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-08-15T22:56:26.422 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-15T22:56:26.476 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:56:26.476 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:56:26.476 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-08-15T22:56:26.476 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.4" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:56:26.477 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:56:26.478 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:56:26.478 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-08-15T22:56:26.478 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:56:26.478 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:56:26.478 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:56:26.478 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:56:26.479 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-08-15T22:56:26.480 DEBUG:teuthology.parallel:result is None 2023-08-15T22:57:02.576 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-15T22:57:02.577 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi178 2023-08-15T22:57:11.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-15T22:57:11.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:57:16.822 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-08-15T22:57:17.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-15T22:57:17.093 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:57:17.093 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:57:17.147 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-08-15T22:57:17.148 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-08-15T22:57:17.202 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-08-15T22:57:17.203 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-08-15T22:57:17.258 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-08-15T22:57:17.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-08-15T22:57:17.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-08-15T22:57:17.401 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-08-15T22:57:17.466 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-08-15T22:57:17.530 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-08-15T22:57:17.593 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-15T22:57:17.647 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:57:17.647 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:57:17.647 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-08-15T22:57:17.647 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-08-15T22:57:17.647 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:57:17.648 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:57:17.649 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-15T22:57:17.649 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:57:17.649 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:57:17.649 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:57:17.649 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:57:17.649 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-08-15T22:57:17.650 DEBUG:teuthology.parallel:result is None 2023-08-15T22:57:22.825 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-08-15T22:57:22.826 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:57:27.851 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-08-15T22:57:27.851 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:57:32.885 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:57:32.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-15T22:57:32.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:57:32.956 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-08-15T22:57:33.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-08-15T22:57:33.026 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-08-15T22:57:33.083 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-08-15T22:57:33.084 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-08-15T22:57:33.140 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:57:33.140 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:57:33.140 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.4" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:57:33.142 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:57:33.143 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-08-15T22:57:35.934 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:57:35.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-15T22:57:35.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:57:36.003 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-08-15T22:57:36.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-15T22:57:36.119 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-08-15T22:57:36.173 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-08-15T22:57:36.174 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-15T22:57:36.227 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2023-08-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2023-08-15T22:57:36.228 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T22:57:36.229 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T22:57:36.230 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-15T22:57:36.230 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T22:57:36.230 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T22:57:36.230 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T22:57:36.230 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T22:57:36.231 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-15T22:57:41.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:57:41.366 INFO:teuthology.dispatcher.supervisor:Running job 7368947 2023-08-15T22:57:41.366 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368947 --name yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi --description fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368947/orig.config.yaml 2023-08-15T22:57:41.369 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368947 2023-08-15T22:57:41.370 INFO:teuthology.dispatcher.supervisor:Job PID: 15745 2023-08-15T22:57:41.370 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T22:59:41.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:01:46.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:03:51.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:05:56.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:07:58.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:10:03.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:12:08.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:14:13.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:16:18.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:18:24.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:20:25.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:22:30.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:22:34.455 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T23:22:34.584 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-15T23:22:34.585 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T23:22:39.638 DEBUG:teuthology.nuke:shortname: smithi022 2023-08-15T23:22:39.638 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:22:44.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:49:41.350277', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAi0I7y0RR2s+FVG0qhNRg/b6cl9q87JNDZzn68VIsvVeXIEqKWYKPbkTgAx6cfoQrb/pepV1fO7yxLcqWPzXS+g17tQraISg9Xxc3tSB+5HRiWA33aFnHsa7XELgEaKjDQmr0wsJZ9qAfSWfSHBhEYrIMFuRcailuI5Vk4v6T3Go7F1TeaJgkQdczUABPIl1oe9BigB+oKpMmGZuYQPmzf+UcagRDyCYbPUw4chIJwR+0V9uPsO0TuyKc0mWbOkp1IYih52fN1SQEliHL3rE4vvfknfHXsyfzjDi5T5rpt8NW9bXKqq4rP8XJo0RuTulm0DkKKkd1xlZO7xnCKxKJ42UgE9Ea+ggA/OYrOjNh+hfRuEDaV9J03CKDkh+jtYaV0mtMmK9DDRmWwolU/cbTxqTcBQq2L6fCFB66EH2O5+4bq/a0Kae8fIJOv13kboSZNyGbCitxTdBxc435LVn+nCMpxQs9KQDLiucsxBZV14PYEwV5YbvF1xRQGWz9fes='} 2023-08-15T23:22:49.649 DEBUG:teuthology.nuke:shortname: smithi178 2023-08-15T23:22:49.650 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:22:49.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:49:41.352555', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHBEI1xfVzKT6ag9mE7umzHGOF1S82b7xLB/eXUy1UMupUndM7wH4GaiuY9mCgTESJIZNoeo+wY7HurJRRbzeJ7xvtTrowNQa1jKKVgDFTgwmFYFCrakDvXo0LqXIeRqbN+9AMoo9Qq+8zP+SUg4TOJdDReCQu69L2Ll8sDQqkMgwVxZXyozgm16t9npjMjJadsJabC3HJKCgl1SBCGLOqPDRdjHDbHPpRuTexe6xag5yhgfbHfp0Jn5BF6vcn5zZGImStlqNt7BpHgdmLjsrMcL30iuAcs5RNtfxnPPXQuT31POuI67OVRokwQTtLjaq0HnQVCSIRq5D8+7zgBXGSAoat2Dl+8vlxLMwfzxLHBD6HIuj81vrlFHE02dV+S1omZ6DDazj2vkinKdVeYpi0kkLW+he8HTPDrt8x1vjnlhQ+s75YD9RXuEQeSf6yL93yyN8Xxj5RWCGyQw/9L9qMfWLzo0USbt8W9ih+YrYiukO3b3MQq5qNFkhff0DnVnE='} 2023-08-15T23:22:49.700 INFO:teuthology.orchestra.console.smithi022:Power off 2023-08-15T23:22:49.701 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:22:49.721 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-08-15T23:22:49.722 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:22:49.739 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-15T23:22:49.739 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:22:49.749 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-08-15T23:22:49.760 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-15T23:22:49.760 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:22:49.783 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-15T23:22:49.851 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-08-15T23:22:49.885 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-15T23:22:50.009 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-08-15T23:22:50.025 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com