2023-08-15T22:01:23.023 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T22:01:23.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:01:32.634 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e42162280>, signals=[15]) 2023-08-15T22:01:32.635 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-08-15T22:01:32.636 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:01:32.636 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-08-15T22:01:32.658 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-08-15T22:01:32.658 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:01:32.658 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-08-15T22:01:32.659 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"} 2023-08-15T22:01:32.682 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-08-15T22:01:32.683 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T22:01:32.683 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-08-15T22:01:32.684 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-08-15T22:01:32.699 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-08-15T22:01:32.731 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-15T22:01:32.752 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-15T22:01:32.763 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-15T22:01:32.766 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-15T22:01:32.766 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 2} 2023-08-15T22:01:32.801 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-15T22:01:32.801 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 2} 2023-08-15T22:01:32.805 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-15T22:01:32.806 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 2} 2023-08-15T22:01:32.814 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of ubuntu 20.04 2023-08-15T22:01:32.814 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:01:32.841 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 20.04 2023-08-15T22:01:32.841 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-15T22:01:32.847 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2023-08-15T22:01:32.847 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:01:32.852 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:01:32.883 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:01:32.886 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T22:01:32.887 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1} 2023-08-15T22:01:32.934 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:01:32.942 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-08-15T22:01:32.946 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-08-15T22:01:32.984 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:01:32.993 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-15T22:01:33.011 INFO:teuthology.orchestra.console.smithi077:Power off 2023-08-15T22:01:33.013 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:01:48.049 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-08-15T22:01:48.049 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:48.070 INFO:teuthology.orchestra.console.smithi167:Power off 2023-08-15T22:01:48.071 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:01:48.086 INFO:teuthology.orchestra.console.smithi149:Power off 2023-08-15T22:01:48.087 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:01:49.059 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:01:53.064 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:53.099 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-08-15T22:01:53.100 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:53.110 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-08-15T22:01:53.111 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:54.109 DEBUG:teuthology.orchestra.console.smithi167:check power output: 2023-08-15T22:01:54.121 DEBUG:teuthology.orchestra.console.smithi149:check power output: 2023-08-15T22:01:54.173 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:01:58.112 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:58.122 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:58.175 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:01:59.223 DEBUG:teuthology.orchestra.console.smithi167:check power output: 2023-08-15T22:01:59.230 DEBUG:teuthology.orchestra.console.smithi149:check power output: 2023-08-15T22:01:59.284 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:02:03.224 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:03.232 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:03.286 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:03.334 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-15T22:02:03.340 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-15T22:02:03.435 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-08-15T22:02:03.442 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-08-15T22:02:03.536 INFO:teuthology.orchestra.console.smithi167:Power on 2023-08-15T22:02:03.536 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:02:03.545 INFO:teuthology.orchestra.console.smithi149:Power on 2023-08-15T22:02:03.545 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:02:03.557 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-08-15T22:02:03.557 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:03.568 DEBUG:teuthology.orchestra.console.smithi149:power on output: Chassis Power Control: Up/On 2023-08-15T22:02:03.569 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:03.581 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-15T22:02:03.591 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-15T22:02:04.397 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:02:07.585 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:07.593 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:08.399 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:08.695 DEBUG:teuthology.orchestra.console.smithi167:check power output: 2023-08-15T22:02:08.702 DEBUG:teuthology.orchestra.console.smithi149:check power output: 2023-08-15T22:02:09.509 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:02:12.697 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:12.705 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:12.814 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2023-08-15T22:02:12.915 INFO:teuthology.orchestra.console.smithi149:Power on completed 2023-08-15T22:02:13.016 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-08-15T22:02:13.016 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-08-15T22:02:18.021 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:18.029 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-15T22:02:18.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:02:18.130 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-08-15T22:02:18.231 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-08-15T22:02:18.231 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:02:23.234 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-15T22:02:23.236 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-08-15T22:02:23.336 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-08-15T22:02:23.437 INFO:teuthology.orchestra.console.smithi077:Power on 2023-08-15T22:02:23.437 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T22:02:28.458 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2023-08-15T22:02:28.459 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:29.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:02:34.241 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:02:37.296 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-15T22:02:38.243 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:38.312 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:02:43.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:02:48.301 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:02:51.376 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-15T22:02:52.303 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:02:53.411 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:02:57.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:03:02.385 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:02.392 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:03:07.399 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-15T22:03:08.401 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:12.406 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:13.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:03:13.516 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:16.464 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-15T22:03:17.518 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:18.628 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:22.456 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:03:27.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:03:32.465 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:33.575 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:37.580 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:38.690 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:42.691 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:43.801 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:47.550 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:03:52.547 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:52.557 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-08-15T22:03:53.659 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:57.660 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:03:58.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:03:58.676 ERROR:teuthology.orchestra.connection:Error authenticating with smithi149.front.sepia.ceph.com: Authentication failed. 2023-08-15T22:03:58.678 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:03:58.679 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:03:58.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:03:58.771 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:03:59.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:00.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:01.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:02.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:02.771 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:04:03.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:03.880 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:04:04.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:05.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:06.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:07.631 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:04:12.639 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:04:12.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:13.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:13.749 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:04:14.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:15.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:16.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:17.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:17.750 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:04:18.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:18.861 DEBUG:teuthology.orchestra.console.smithi077:check power output: 2023-08-15T22:04:19.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:20.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:21.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:22.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:22.863 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:04:23.029 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-08-15T22:04:23.131 INFO:teuthology.orchestra.console.smithi077:Power on completed 2023-08-15T22:04:23.231 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-08-15T22:04:23.232 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:04:27.748 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:04:27.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:28.756 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:29.760 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:30.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:31.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:32.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:33.779 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:34.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:35.787 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:36.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:37.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:38.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:39.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:40.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:41.819 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:42.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:42.833 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:04:47.834 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:04:52.840 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:52.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:53.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:54.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:55.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:56.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:57.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:58.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:04:59.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:00.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:01.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:02.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:03.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:05.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:06.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:07.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:07.907 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:05:07.912 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:05:08.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:09.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:10.023 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:11.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:12.033 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:13.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:14.042 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:15.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:16.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:17.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:18.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:19.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:20.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:21.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:22.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:23.001 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:05:28.009 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:05:33.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:33.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:34.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:35.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:36.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:37.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:38.142 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:39.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:40.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:41.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:42.160 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:43.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:44.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:45.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:46.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:47.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:48.097 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:05:52.993 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T22:05:58.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-15T22:05:58.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:06.160 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T22:06:12.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:13.085 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-08-15T22:06:18.089 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T22:06:18.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:24.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:29.093 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-15T22:06:32.144 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T22:06:35.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:38.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:43.152 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-15T22:06:46.224 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T22:06:49.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:54.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:06:59.164 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-08-15T22:07:02.224 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T22:07:05.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:07:10.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:07:28.629 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T22:07:34.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:07:41.316 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:07:41.317 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:07:49.360 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-15T22:07:49.362 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi149 2023-08-15T22:07:58.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-15T22:07:58.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:07:58.584 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-08-15T22:07:59.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-15T22:07:59.063 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:07:59.063 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:08:03.038 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-08-15T22:08:03.038 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-08-15T22:08:03.045 INFO:teuthology.orchestra.run.smithi167.stdout:smithi129 2023-08-15T22:08:03.045 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi129 /etc/hosts 2023-08-15T22:08:03.053 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.129 smithi129 smithi129 2023-08-15T22:08:03.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-08-15T22:08:03.145 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi129/smithi167/g' /etc/hosts 2023-08-15T22:08:03.162 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.129/172.21.15.167/g' /etc/hosts 2023-08-15T22:08:03.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi129/smithi167/g' /etc/hostname 2023-08-15T22:08:03.236 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-08-15T22:08:03.251 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-08-15T22:08:03.256 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-08-15T22:08:03.256 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T22:08:03.256 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-08-15T22:08:03.256 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T22:08:03.257 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-08-15T22:08:03.258 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-08-15T22:08:03.258 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-08-15T22:08:03.259 DEBUG:teuthology.parallel:result is None 2023-08-15T22:08:04.071 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-08-15T22:08:04.071 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-08-15T22:08:04.077 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-08-15T22:08:04.078 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-08-15T22:08:04.084 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-08-15T22:08:04.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-08-15T22:08:04.208 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-08-15T22:08:04.223 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-08-15T22:08:04.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-08-15T22:08:04.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-08-15T22:08:04.309 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-08-15T22:08:04.313 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-08-15T22:08:04.313 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T22:08:04.313 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T22:08:04.314 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T22:08:04.315 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-08-15T22:08:04.315 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-08-15T22:08:04.315 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-08-15T22:08:04.315 DEBUG:teuthology.parallel:result is None 2023-08-15T22:08:10.173 WARNING:teuthology.provision.fog.smithi077:timed out 2023-08-15T22:08:16.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:08:21.388 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T22:08:21.388 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T22:08:21.961 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-08-15T22:08:21.961 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-08-15T22:08:21.968 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-08-15T22:08:21.968 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2023-08-15T22:08:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-08-15T22:08:22.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-08-15T22:08:22.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2023-08-15T22:08:22.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2023-08-15T22:08:22.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2023-08-15T22:08:22.139 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-08-15T22:08:22.199 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-08-15T22:08:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2023-08-15T22:08:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T22:08:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2023-08-15T22:08:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2023-08-15T22:08:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T22:08:22.203 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="20.04" 2023-08-15T22:08:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T22:08:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T22:08:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T22:08:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T22:08:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=focal 2023-08-15T22:08:22.204 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=focal 2023-08-15T22:08:22.205 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-08-15T22:08:22.205 DEBUG:teuthology.parallel:result is None 2023-08-15T22:08:24.059 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-08-15T22:08:24.060 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-08-15T22:08:24.060 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:08:28.602 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-08-15T22:08:28.602 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T22:08:28.620 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:08:28.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-08-15T22:08:28.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:08:28.680 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-08-15T22:08:28.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-08-15T22:08:28.802 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-08-15T22:08:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-08-15T22:08:28.808 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-08-15T22:08:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2023-08-15T22:08:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T22:08:28.813 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="20.04" 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T22:08:28.814 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T22:08:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=focal 2023-08-15T22:08:28.815 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=focal 2023-08-15T22:08:28.815 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-08-15T22:08:28.836 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:08:28.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-15T22:08:28.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:08:28.887 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-08-15T22:08:29.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-08-15T22:08:29.014 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-08-15T22:08:29.020 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-08-15T22:08:29.020 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-08-15T22:08:29.068 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-08-15T22:08:29.069 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T22:08:29.069 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-08-15T22:08:29.069 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-08-15T22:08:29.070 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T22:08:29.070 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-08-15T22:08:29.070 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T22:08:29.070 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T22:08:29.071 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T22:08:29.071 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T22:08:29.071 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-08-15T22:08:29.072 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-08-15T22:08:29.072 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-08-15T22:08:29.102 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-08-15T22:08:29.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-08-15T22:08:29.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T22:08:29.151 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-08-15T22:08:29.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-08-15T22:08:29.418 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-08-15T22:08:29.424 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-08-15T22:08:29.424 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-08-15T22:08:29.430 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-08-15T22:08:29.431 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T22:08:29.431 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-08-15T22:08:29.431 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-08-15T22:08:29.431 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T22:08:29.431 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-08-15T22:08:29.431 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T22:08:29.432 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T22:08:29.432 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T22:08:29.432 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T22:08:29.432 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-08-15T22:08:29.432 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-08-15T22:08:29.432 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-08-15T22:08:29.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:08:29.545 INFO:teuthology.dispatcher.supervisor:Running job 7368862 2023-08-15T22:08:29.546 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368862 --name yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi --description fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} -- /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368862/orig.config.yaml 2023-08-15T22:08:29.549 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368862 2023-08-15T22:08:29.549 INFO:teuthology.dispatcher.supervisor:Job PID: 17585 2023-08-15T22:08:29.550 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T22:10:29.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:12:33.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:14:38.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:16:44.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:18:49.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:20:54.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:22:59.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:25:00.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:27:05.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:29:10.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:31:10.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:33:14.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:35:15.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T22:35:20.212 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T22:35:27.794 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-15T22:35:27.795 INFO:teuthology.nuke:Checking targets against current locks 2023-08-15T22:35:27.839 DEBUG:teuthology.nuke:shortname: smithi077 2023-08-15T22:35:27.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T22:35:27.858 DEBUG:teuthology.nuke:shortname: smithi149 2023-08-15T22:35:27.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T22:35:27.860 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:01:13.449452', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-15T22:35:27.874 DEBUG:teuthology.nuke:shortname: smithi167 2023-08-15T22:35:27.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-15T22:35:27.878 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:01:13.453220', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-15T22:35:27.894 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_16:56:50-fs-wip-yuri7-testing-2023-08-15-0741-pacific-distro-default-smithi/7368862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-15 22:01:13.451452', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-08-15T22:35:27.908 INFO:teuthology.orchestra.console.smithi077:Power off 2023-08-15T22:35:27.909 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:35:27.929 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-08-15T22:35:27.929 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:35:27.945 INFO:teuthology.orchestra.console.smithi167:Power off 2023-08-15T22:35:27.946 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:35:27.959 INFO:teuthology.orchestra.console.smithi149:Power off 2023-08-15T22:35:27.960 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T22:35:27.968 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-08-15T22:35:27.969 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:35:27.979 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-08-15T22:35:27.981 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2023-08-15T22:35:27.981 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T22:35:27.993 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-15T22:35:28.001 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2023-08-15T22:35:28.080 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-08-15T22:35:28.094 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-08-15T22:35:28.102 INFO:teuthology.orchestra.console.smithi149:Power off completed 2023-08-15T22:35:28.226 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2023-08-15T22:35:28.235 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2023-08-15T22:35:28.243 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com