2023-08-15T22:58:33.815 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T22:58:33.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:58:33.969 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3fae412f70>, signals=[15]) 2023-08-15T22:58:33.970 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-08-15T22:58:33.970 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:58:33.971 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-08-15T22:58:33.992 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-08-15T22:58:33.992 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:58:33.993 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-08-15T22:58:33.994 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-08-15T22:58:44.033 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-08-15T22:58:54.068 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:59:04.104 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-08-15T22:59:09.112 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:59:09.113 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 7} 2023-08-15T22:59:14.159 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.4 (ID 7) 2023-08-15T22:59:14.159 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 7} 2023-08-15T22:59:14.170 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.4 2023-08-15T22:59:14.170 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-08-15T22:59:14.230 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.4 2023-08-15T22:59:14.231 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-08-15T22:59:14.234 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:59:14.291 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-08-15T22:59:14.305 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:59:14.363 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-08-15T22:59:14.365 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-08-15T22:59:14.427 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-08-15T22:59:24.470 INFO:teuthology.orchestra.console.smithi088:Power off 2023-08-15T22:59:24.471 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:59:34.524 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-08-15T22:59:34.524 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:34.548 INFO:teuthology.orchestra.console.smithi144:Power off 2023-08-15T22:59:34.549 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:59:35.535 DEBUG:teuthology.orchestra.console.smithi088:check power output: 2023-08-15T22:59:39.540 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:39.574 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-08-15T22:59:39.574 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:40.584 DEBUG:teuthology.orchestra.console.smithi144:check power output: 2023-08-15T22:59:40.651 DEBUG:teuthology.orchestra.console.smithi088:check power output: 2023-08-15T22:59:44.586 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:44.652 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:44.764 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-08-15T22:59:44.865 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-08-15T22:59:44.966 INFO:teuthology.orchestra.console.smithi088:Power on 2023-08-15T22:59:44.966 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:59:44.987 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-08-15T22:59:44.987 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:45.008 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-08-15T22:59:45.696 DEBUG:teuthology.orchestra.console.smithi144:check power output: 2023-08-15T22:59:49.012 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:49.121 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-08-15T22:59:49.697 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:49.806 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-08-15T22:59:49.907 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-08-15T22:59:50.008 INFO:teuthology.orchestra.console.smithi144:Power on 2023-08-15T22:59:50.008 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:59:50.028 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-08-15T22:59:50.029 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:50.056 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-08-15T22:59:53.126 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:54.058 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:54.235 DEBUG:teuthology.orchestra.console.smithi088:check power output: 2023-08-15T22:59:55.168 DEBUG:teuthology.orchestra.console.smithi144:check power output: 2023-08-15T22:59:58.236 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:59.169 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:59:59.345 DEBUG:teuthology.orchestra.console.smithi088:check power output: 2023-08-15T23:00:00.279 DEBUG:teuthology.orchestra.console.smithi144:check power output: 2023-08-15T23:00:03.346 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:00:03.455 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-08-15T23:00:03.556 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-08-15T23:00:03.657 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-08-15T23:00:03.657 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-08-15T23:00:06.997 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:00:07.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:07.107 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-08-15T23:00:07.208 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-08-15T23:00:07.309 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-08-15T23:00:07.309 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-08-15T23:00:12.317 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:00:12.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:18.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:20.464 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-08-15T23:00:21.392 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:00:26.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:27.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:30.736 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-08-15T23:00:30.737 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:00:36.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:36.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:39.792 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-08-15T23:00:39.824 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:00:45.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:50.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:00:53.872 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:00:53.876 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-08-15T23:00:59.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:01:04.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:01:09.890 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:01:15.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:01:28.308 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-08-15T23:01:34.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:01:39.315 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-15T23:01:39.432 ERROR:teuthology.orchestra.connection:Error authenticating with smithi144.front.sepia.ceph.com: Authentication failed. 2023-08-15T23:01:39.434 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T23:01:39.435 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T23:01:39.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:40.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:41.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:42.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:43.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:44.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:45.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:01:45.437 ERROR:teuthology.orchestra.connection:Error authenticating with smithi088.front.sepia.ceph.com: Authentication failed. 2023-08-15T23:01:45.438 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T23:01:45.438 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T23:01:45.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:45.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:46.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:46.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:47.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:47.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:48.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:48.494 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:49.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:49.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:50.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:50.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:51.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:51.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:52.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:52.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:53.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:53.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:54.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:54.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:55.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:55.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:56.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:56.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:57.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:57.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:58.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:58.581 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:59.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:01:59.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:00.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:00.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:01.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:01.607 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:02.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:02.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:03.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:03.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:04.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:04.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:05.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:05.638 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:06.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:06.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:07.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:07.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:08.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:08.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:09.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:09.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:10.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:10.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:11.667 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:11.691 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:12.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:12.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:13.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:13.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:14.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:14.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:15.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:15.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:16.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:16.738 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:17.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:17.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:18.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:18.756 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:19.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:19.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:20.749 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:20.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:21.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:21.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:22.766 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:22.790 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:23.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:23.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:24.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:24.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:25.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:25.817 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:26.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:26.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:27.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:27.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:28.819 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:28.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:29.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:29.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:30.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:30.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:31.845 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:31.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:32.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:33.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:34.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:35.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:36.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:37.901 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:38.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:39.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:40.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:41.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:02:42.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T23:04:20.848 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-15T23:04:20.850 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi144 2023-08-15T23:04:29.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-08-15T23:04:29.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:04:35.155 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-08-15T23:04:35.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-08-15T23:04:35.428 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T23:04:35.429 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T23:04:35.481 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-08-15T23:04:35.481 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-08-15T23:04:35.534 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144 2023-08-15T23:04:35.535 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144 /etc/hosts 2023-08-15T23:04:35.587 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-08-15T23:04:35.588 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-08-15T23:04:35.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144/smithi144/g' /etc/hosts 2023-08-15T23:04:35.758 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-08-15T23:04:35.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144/smithi144/g' /etc/hostname 2023-08-15T23:04:35.885 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-08-15T23:04:35.948 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-08-15T23:04:36.001 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T23:04:36.001 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T23:04:36.002 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-08-15T23:04:36.002 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-08-15T23:04:36.002 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.4" 2023-08-15T23:04:36.002 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-08-15T23:04:36.002 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T23:04:36.002 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T23:04:36.003 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T23:04:36.004 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T23:04:36.004 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-08-15T23:04:36.006 DEBUG:teuthology.parallel:result is None 2023-08-15T23:06:17.584 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-15T23:06:17.585 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi088 2023-08-15T23:06:26.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-15T23:06:26.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:06:26.847 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-08-15T23:06:27.100 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-15T23:06:27.100 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T23:06:27.101 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T23:06:27.155 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-08-15T23:06:27.155 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-08-15T23:06:27.211 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-08-15T23:06:27.211 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-08-15T23:06:27.267 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-08-15T23:06:27.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-08-15T23:06:27.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-08-15T23:06:27.413 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-08-15T23:06:27.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-08-15T23:06:27.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-08-15T23:06:27.607 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-08-15T23:06:27.662 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T23:06:27.662 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.4" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T23:06:27.663 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T23:06:27.664 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T23:06:27.664 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T23:06:27.664 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-15T23:06:27.664 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T23:06:27.664 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T23:06:27.665 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T23:06:27.665 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T23:06:27.665 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-08-15T23:06:27.666 DEBUG:teuthology.parallel:result is None 2023-08-15T23:06:27.804 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-08-15T23:06:27.805 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T23:06:32.843 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-08-15T23:06:32.844 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T23:06:37.878 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-08-15T23:06:37.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-15T23:06:37.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:06:42.952 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-08-15T23:06:43.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-15T23:06:43.067 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-08-15T23:06:43.122 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-08-15T23:06:43.122 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-08-15T23:06:43.177 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T23:06:43.177 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T23:06:43.177 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-08-15T23:06:43.177 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-08-15T23:06:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.4" 2023-08-15T23:06:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-08-15T23:06:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T23:06:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-08-15T23:06:43.178 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T23:06:43.179 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T23:06:43.179 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T23:06:43.179 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T23:06:43.179 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-15T23:06:43.179 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T23:06:43.180 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T23:06:43.180 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T23:06:43.180 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T23:06:43.181 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-08-15T23:06:48.208 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-08-15T23:06:48.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-08-15T23:06:48.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T23:06:53.276 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-08-15T23:06:53.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-08-15T23:06:53.398 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-08-15T23:06:53.452 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-08-15T23:06:53.453 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-08-15T23:06:53.506 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-08-15T23:06:53.506 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.4 (Ootpa)" 2023-08-15T23:06:53.506 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.4" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-08-15T23:06:53.507 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-15T23:06:53.508 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-08-15T23:06:53.509 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-08-15T23:06:58.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:07:03.639 INFO:teuthology.dispatcher.supervisor:Running job 7368968 2023-08-15T23:07:03.640 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368968 --name yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368968/orig.config.yaml 2023-08-15T23:07:03.643 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368968 2023-08-15T23:07:03.644 INFO:teuthology.dispatcher.supervisor:Job PID: 15523 2023-08-15T23:07:03.644 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T23:09:03.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:11:06.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:13:11.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:15:16.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:17:16.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:19:22.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:21:27.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:23:32.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:25:33.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:27:33.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:29:38.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:31:43.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T23:31:49.015 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T23:31:59.132 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-15T23:31:59.132 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T23:32:06.772 DEBUG:teuthology.nuke:shortname: smithi088 2023-08-15T23:32:06.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:32:06.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368968', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:58:31.683198', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBN7DbyIyaUBsoesDRZjBG7X5qjWL48sBpkJWkNbrOZFIrybYmXflOEB34qE8ngh1EpEq5QxDs/BoYpVlwM8mgjAZ2zm1iH2oPbNoXHY0zB3Ee5QsWPiAe8bHonj+uSVLFaHT6QutrGDPZCaHFQvYYYwoHECLHbDyrvxjc7MYh+/yjKzRZ+vXjAhust8C4VsUJ0WXxTqQteSISBR3RLfPE2zMLiDatPY1FuTmoXh4OqGuTsUmzX8YkRmkYX+TaUip8KcN89jWMhu+wDvayoA9tdp1/tS5/MGFMYfYlHyiSVDZrITv2WmuD0UchkJNkPX45WfmGFsQMqSHjY68DyhnaLwv/qrydF8xj2B91Ektf5Hqo2ObYitJ32qj8B3Gf+R4oriU5VT2ei1Xo1TCDEvPExmXKOU4mZ/L53N6BCrDJXo7OVfPljJnIVYlYJlgf7RiVhuED5mpV3qYhD7XBHWHZVvdokqkn/Flvn084BF12Z+sc21A98z8eD0edWoPTZhE='} 2023-08-15T23:32:06.794 DEBUG:teuthology.nuke:shortname: smithi144 2023-08-15T23:32:06.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T23:32:06.813 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368968', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:58:31.681408', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDaQzuQcuRCs9wSqdORja6H1bbL/zuZ5is+YldxC7Z4vVNeX6FnGie92+DZHE3KDesVUGe8p8l6zKpW4RK5nkk0mxGezkb3HkcyAZ794XBNiZxC9AyEdjq+wFmGF98D8XO1jwQA+IHnYOFHwwabRhTO2V6cUJUrHLLewqUmFrPOPdd2US5VhlsiRquKRFwSLGNW3Ql3RhmXNHiuXr6O1JTO63KThzy1uTxTAqaMdcXgKQG3lyks6cdWPJ99aPZD1pOWCvVj9DHBRWsdx7/xyG4PPCKpQzcRp/Fm4+dmgcpMAyVm7mm9Jkv6gcocPShc0/yU9oBT2oHgQt0zEZEhn932Gz3Xq89tallexlLG7D68m0hyBcDL4KqUDwQUhd4eTR51jvIJ7DdmIdGIVrTw8HrsgnnUO9qz2tb8UKr+hEwCWXVj2Jbrx8j/QW+A37fMGnjcabp+2XQAXi6PI1gZG+AttDCxQz59Xct82vSpzNlPxR/mEUMwmfUByTsCDm7IADU='} 2023-08-15T23:32:06.838 INFO:teuthology.orchestra.console.smithi088:Power off 2023-08-15T23:32:06.839 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:32:06.858 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-08-15T23:32:06.859 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:32:06.875 INFO:teuthology.orchestra.console.smithi144:Power off 2023-08-15T23:32:06.876 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T23:32:06.886 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-08-15T23:32:06.898 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-08-15T23:32:06.899 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T23:32:06.920 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-08-15T23:32:06.988 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-08-15T23:32:07.021 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-08-15T23:32:07.146 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-08-15T23:32:07.170 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com