2023-10-23T17:45:55.319 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-23T17:45:55.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T17:45:55.477 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7ac0b62dc0>, signals=[15]) 2023-10-23T17:45:55.478 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-10-23T17:45:55.479 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:55.479 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-23T17:45:55.493 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-23T17:45:55.494 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:55.494 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-23T17:45:55.496 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-10-23T17:45:55.519 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-23T17:45:55.519 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:55.520 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-23T17:45:55.521 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-23T17:45:55.544 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-23T17:45:55.563 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:55.603 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:55.604 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 2} 2023-10-23T17:45:55.607 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:55.620 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:55.641 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:55.641 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 2} 2023-10-23T17:45:55.646 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:55.646 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:45:55.663 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:55.663 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 2} 2023-10-23T17:45:55.685 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:55.685 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:45:55.705 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:55.705 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:45:55.713 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:55.745 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-10-23T17:45:55.749 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:55.766 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:55.781 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-23T17:45:55.796 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-23T17:45:55.801 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:45:55.842 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:45:55.845 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:45:55.929 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-23T17:45:55.930 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:55.946 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-23T17:45:55.946 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:55.954 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:55.955 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:55.966 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-23T17:45:55.967 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:55.974 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:55.975 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:55.983 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-23T17:45:55.987 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:55.987 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:55.996 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-23T17:45:56.007 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-23T17:45:59.986 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:59.998 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:00.008 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:00.095 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-23T17:46:00.106 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-23T17:46:00.118 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-23T17:46:04.101 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:04.107 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:04.119 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:04.209 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-23T17:46:04.216 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-23T17:46:04.226 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-23T17:46:04.310 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-23T17:46:04.316 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-23T17:46:04.411 INFO:teuthology.orchestra.console.smithi003:Power on 2023-10-23T17:46:04.411 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:04.418 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-23T17:46:04.419 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:04.432 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:04.433 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:04.441 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:04.442 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:04.456 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-23T17:46:04.462 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-23T17:46:08.231 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:08.340 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-23T17:46:08.440 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-23T17:46:08.457 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:08.463 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:08.542 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-23T17:46:08.542 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:08.562 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:08.563 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:08.570 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-23T17:46:08.572 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-23T17:46:08.582 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-23T17:46:12.575 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:12.581 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:12.589 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:12.691 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-23T17:46:12.697 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-23T17:46:12.756 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-23T17:46:12.792 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-23T17:46:12.797 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-23T17:46:12.857 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-10-23T17:46:12.893 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-23T17:46:12.893 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:46:12.898 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-23T17:46:12.899 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:46:12.959 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-10-23T17:46:12.959 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:46:28.068 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:46:28.069 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:46:28.118 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:46:43.258 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:46:43.261 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:46:43.272 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:46:58.426 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:46:58.429 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:46:58.431 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:47:13.618 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:47:13.619 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:47:13.620 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:47:28.822 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:47:28.825 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:47:28.826 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:47:44.039 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:47:44.041 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:47:44.042 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:47:59.251 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:47:59.253 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:47:59.254 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:48:14.498 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:48:14.499 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:48:14.500 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:48:29.732 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:48:29.734 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:48:29.772 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:48:44.973 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:48:44.974 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:48:44.978 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:49:00.224 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:49:00.226 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:49:00.231 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:49:15.466 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:49:15.468 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:49:15.469 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:49:30.682 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:49:30.686 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:49:30.688 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:49:45.892 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:49:45.894 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:49:45.895 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:50:01.106 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-23T17:50:01.108 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:50:01.109 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:50:01.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:50:16.292 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:50:16.298 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:50:19.771 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-23T17:50:25.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:50:28.827 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-23T17:50:31.467 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:50:31.479 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:50:34.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:50:37.914 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-23T17:50:43.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:50:46.633 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:50:46.650 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:51:01.827 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:51:01.829 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:51:16.999 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:51:17.001 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:51:32.146 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:51:32.148 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:51:43.936 WARNING:teuthology.provision.fog.smithi003:timed out 2023-10-23T17:51:47.284 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:51:47.285 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:51:49.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:51:50.166 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:51:50.167 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:51:50.641 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-10-23T17:51:50.641 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-10-23T17:51:50.649 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-10-23T17:51:50.649 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-10-23T17:51:50.657 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-10-23T17:51:50.658 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-23T17:51:50.785 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-10-23T17:51:50.803 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-10-23T17:51:50.819 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-10-23T17:51:50.830 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-23T17:51:50.889 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-23T17:51:50.894 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-23T17:51:50.895 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:51:50.895 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-23T17:51:50.895 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-23T17:51:50.895 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:51:50.896 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-23T17:51:50.896 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:51:50.896 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:51:50.896 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:51:50.897 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:51:50.897 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-23T17:51:50.897 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:51:50.898 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-10-23T17:51:50.900 DEBUG:teuthology.parallel:result is None 2023-10-23T17:52:02.442 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-23T17:52:02.443 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:52:02.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:17.557 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:52:21.114 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-23T17:52:27.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:30.170 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-23T17:52:32.681 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:52:36.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:39.226 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-23T17:52:45.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:47.810 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:52:48.314 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-23T17:52:54.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:57.402 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-23T17:53:02.938 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:53:03.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:18.061 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:53:33.179 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:53:35.257 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:53:35.258 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:53:48.273 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:53:51.011 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-23T17:53:51.011 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-23T17:53:51.018 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-10-23T17:53:51.018 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-10-23T17:53:51.066 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-23T17:53:51.067 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-23T17:53:51.149 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-10-23T17:53:51.165 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-23T17:53:51.224 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-10-23T17:53:51.234 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-23T17:53:51.249 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-23T17:53:51.254 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2023-10-23T17:53:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:53:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2023-10-23T17:53:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2023-10-23T17:53:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:53:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="20.04" 2023-10-23T17:53:51.255 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:53:51.256 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:53:51.256 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:53:51.256 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:53:51.256 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=focal 2023-10-23T17:53:51.256 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:53:51.257 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-10-23T17:53:51.257 DEBUG:teuthology.parallel:result is None 2023-10-23T17:54:03.357 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:54:18.434 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:54:33.498 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:54:48.558 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:55:03.628 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:55:18.706 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:55:33.770 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-23T17:55:33.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:55:52.314 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-23T17:55:58.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:01.402 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-23T17:56:07.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:10.462 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-23T17:56:16.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:19.546 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-23T17:56:25.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:57:25.611 WARNING:teuthology.provision.fog.smithi183:timed out 2023-10-23T17:57:31.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:57:31.845 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:57:31.846 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:57:32.348 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-23T17:57:32.348 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-23T17:57:32.355 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-23T17:57:32.355 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-23T17:57:32.404 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-23T17:57:32.405 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-23T17:57:32.500 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-23T17:57:32.518 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-23T17:57:32.578 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-23T17:57:32.589 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-23T17:57:32.599 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-23T17:57:32.647 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-10-23T17:57:32.648 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:57:32.648 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-10-23T17:57:32.648 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-10-23T17:57:32.648 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:57:32.648 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2023-10-23T17:57:32.649 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:57:32.649 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:57:32.649 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:57:32.649 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:57:32.649 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2023-10-23T17:57:32.650 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:57:32.650 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-23T17:57:32.651 DEBUG:teuthology.parallel:result is None 2023-10-23T17:57:33.015 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-10-23T17:57:33.016 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:57:33.034 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-10-23T17:57:33.035 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:57:33.051 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-10-23T17:57:33.051 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:57:33.069 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:57:33.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-23T17:57:33.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:57:33.119 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-23T17:57:33.320 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-23T17:57:33.320 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-10-23T17:57:33.326 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-10-23T17:57:33.327 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-23T17:57:33.333 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-23T17:57:33.333 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:57:33.333 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-23T17:57:33.334 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-23T17:57:33.334 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:57:33.334 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-23T17:57:33.334 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:57:33.334 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:57:33.335 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:57:33.335 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:57:33.335 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-23T17:57:33.335 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:57:33.336 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-23T17:57:33.360 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:57:33.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-23T17:57:33.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:57:33.411 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-23T17:57:33.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-23T17:57:33.620 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-23T17:57:33.626 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-23T17:57:33.627 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-23T17:57:33.675 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2023-10-23T17:57:33.676 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:57:33.676 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2023-10-23T17:57:33.676 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2023-10-23T17:57:33.676 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:57:33.676 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="20.04" 2023-10-23T17:57:33.677 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:57:33.677 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:57:33.677 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:57:33.677 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:57:33.677 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=focal 2023-10-23T17:57:33.678 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:57:33.678 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-23T17:57:33.701 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:57:33.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-23T17:57:33.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:57:33.753 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-23T17:57:33.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-23T17:57:33.872 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-23T17:57:33.878 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-23T17:57:33.879 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-23T17:57:33.885 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-10-23T17:57:33.885 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:57:33.885 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-10-23T17:57:33.886 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-10-23T17:57:33.886 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:57:33.886 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2023-10-23T17:57:33.886 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:57:33.887 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:57:33.887 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:57:33.887 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:57:33.887 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2023-10-23T17:57:33.887 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:57:33.888 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-23T17:57:33.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T17:57:34.006 INFO:teuthology.dispatcher.supervisor:Running job 7434906 2023-10-23T17:57:34.006 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434906 --name lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434906/orig.config.yaml 2023-10-23T17:57:34.009 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434906 2023-10-23T17:57:34.010 INFO:teuthology.dispatcher.supervisor:Job PID: 3523714 2023-10-23T17:57:34.010 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-23T17:59:34.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:01:34.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:03:34.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:05:34.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:07:34.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:09:34.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:11:35.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:13:35.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:15:35.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:17:35.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:19:35.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:21:35.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:23:35.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:25:36.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:27:36.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:29:36.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:31:36.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:33:36.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:35:36.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:37:37.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:39:37.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:41:37.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:43:37.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:45:37.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:47:37.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:49:37.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:51:38.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:53:38.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:55:38.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:57:38.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:59:38.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:01:38.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:03:39.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:05:39.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:07:39.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:09:39.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:11:39.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:13:39.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:15:40.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:17:40.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:19:40.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:21:40.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:23:40.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:25:40.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:27:41.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:29:41.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:31:41.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:33:41.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:35:41.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:37:41.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:39:41.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:41:42.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:43:42.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:45:42.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:47:42.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:49:42.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:51:42.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:53:43.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:55:43.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:57:43.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:59:43.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:01:43.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:03:43.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:05:43.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:07:44.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:09:44.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:11:44.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:13:44.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:15:44.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:17:44.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:19:45.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:21:45.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:23:45.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:25:45.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:27:45.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:29:45.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:31:45.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:33:45.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:35:46.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:35:46.150 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-23T20:35:46.427 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-23T20:35:46.427 INFO:teuthology.nuke:Checking targets against current locks 2023-10-23T20:35:46.475 DEBUG:teuthology.nuke:shortname: smithi003 2023-10-23T20:35:46.476 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:35:46.498 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-23T20:35:46.498 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:35:46.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434906', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:54.482622', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:35:46.516 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434906', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:54.478024', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:35:46.517 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-23T20:35:46.517 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:35:46.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434906', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:54.481027', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:35:46.550 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-23T20:35:46.550 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:35:46.565 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-23T20:35:46.566 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:35:46.578 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-23T20:35:46.579 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:35:46.587 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-23T20:35:46.588 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:35:46.600 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-23T20:35:46.611 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-23T20:35:46.611 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:35:46.618 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-23T20:35:46.630 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-23T20:35:46.630 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:35:46.650 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-23T20:35:46.701 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-23T20:35:46.719 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-23T20:35:46.752 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-23T20:35:46.847 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-10-23T20:35:46.865 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-10-23T20:35:46.898 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com