2023-08-17T03:10:45.748 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-17T03:10:45.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:10:45.885 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fab1c4a3f70>, signals=[15]) 2023-08-17T03:10:45.887 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-08-17T03:10:45.888 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T03:10:45.888 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-17T03:10:45.911 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-08-17T03:10:45.911 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T03:10:45.911 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-17T03:10:45.913 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-08-17T03:10:45.935 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-08-17T03:10:45.984 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-17T03:10:45.995 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-17T03:10:46.032 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-17T03:10:46.033 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 2} 2023-08-17T03:10:46.043 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-17T03:10:46.044 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 2} 2023-08-17T03:10:46.075 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 20.04 2023-08-17T03:10:46.075 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:10:46.090 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 20.04 2023-08-17T03:10:46.090 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:10:46.125 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T03:10:46.137 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T03:10:46.175 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-08-17T03:10:46.183 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-08-17T03:10:46.240 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:10:46.243 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:10:46.328 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-17T03:10:46.330 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T03:10:46.347 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-17T03:10:46.348 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T03:10:46.360 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-17T03:10:46.361 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:46.374 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-17T03:10:46.375 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:46.387 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-17T03:10:46.398 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-17T03:10:46.489 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-17T03:10:46.590 INFO:teuthology.orchestra.console.smithi178:Power on 2023-08-17T03:10:46.590 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T03:10:46.613 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2023-08-17T03:10:46.614 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:46.637 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-17T03:10:50.400 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:50.510 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-17T03:10:50.639 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:50.748 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-17T03:10:50.849 INFO:teuthology.orchestra.console.smithi178:Power on completed 2023-08-17T03:10:50.950 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-08-17T03:10:50.950 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:10:54.515 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:54.625 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-17T03:10:58.628 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:58.739 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-17T03:10:58.841 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-17T03:10:58.942 INFO:teuthology.orchestra.console.smithi141:Power on 2023-08-17T03:10:58.943 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T03:10:58.967 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-08-17T03:10:58.968 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:10:58.990 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-17T03:11:02.994 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T03:11:03.104 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-17T03:11:03.206 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-08-17T03:11:03.306 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-08-17T03:11:03.307 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:11:06.014 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:11:18.393 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:11:21.084 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:11:33.480 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:11:36.148 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:11:48.564 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:11:51.221 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:12:03.644 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:12:06.282 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:12:18.716 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:12:21.356 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:12:33.792 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:12:36.424 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:12:48.852 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:12:51.480 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:13:03.930 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:13:06.536 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:13:18.996 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:13:21.588 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:13:34.069 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:13:36.663 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:13:49.172 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:13:51.752 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:14:04.248 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:14:06.824 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:14:19.320 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:14:21.896 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:14:34.399 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:14:36.967 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:14:49.484 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-17T03:14:49.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:14:52.036 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:15:07.114 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-17T03:15:07.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:15:10.256 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:15:16.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:15:19.312 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:15:19.649 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication timeout. 2023-08-17T03:15:19.650 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T03:15:19.651 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T03:15:25.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:15:28.368 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:15:34.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:15:37.424 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:15:43.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:15:46.480 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:15:52.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:15:55.536 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:16:01.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:16:04.592 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-17T03:16:10.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:17:07.316 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-17T03:17:07.318 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi141 2023-08-17T03:17:10.596 WARNING:teuthology.provision.fog.smithi178:timed out 2023-08-17T03:17:16.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-17T03:17:16.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:17:16.433 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-17T03:17:16.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:17:16.728 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T03:17:16.728 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T03:17:16.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-17T03:17:16.891 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T03:17:16.891 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T03:17:16.897 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-08-17T03:17:16.897 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-08-17T03:17:16.903 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-08-17T03:17:16.903 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-08-17T03:17:16.952 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-08-17T03:17:16.953 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-17T03:17:17.048 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-08-17T03:17:17.066 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-08-17T03:17:17.128 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-08-17T03:17:17.140 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-08-17T03:17:17.150 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-17T03:17:17.154 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2023-08-17T03:17:17.154 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-17T03:17:17.155 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2023-08-17T03:17:17.155 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2023-08-17T03:17:17.155 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-17T03:17:17.155 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="20.04" 2023-08-17T03:17:17.155 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-17T03:17:17.155 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-17T03:17:17.156 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-17T03:17:17.156 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-17T03:17:17.156 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=focal 2023-08-17T03:17:17.156 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=focal 2023-08-17T03:17:17.157 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-08-17T03:17:17.157 DEBUG:teuthology.parallel:result is None 2023-08-17T03:17:17.402 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-08-17T03:17:17.402 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-08-17T03:17:17.408 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-08-17T03:17:17.409 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-08-17T03:17:17.416 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-08-17T03:17:17.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-08-17T03:17:17.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-08-17T03:17:17.564 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-08-17T03:17:17.575 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-08-17T03:17:17.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-08-17T03:17:17.599 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-17T03:17:17.605 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-08-17T03:17:17.605 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-17T03:17:17.605 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-08-17T03:17:17.605 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="20.04" 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-17T03:17:17.606 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=focal 2023-08-17T03:17:17.607 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=focal 2023-08-17T03:17:17.607 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-08-17T03:17:17.607 DEBUG:teuthology.parallel:result is None 2023-08-17T03:17:17.952 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-08-17T03:17:17.953 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-17T03:17:17.990 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-08-17T03:17:17.992 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-08-17T03:17:17.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-17T03:17:17.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:17:18.039 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-17T03:17:18.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-17T03:17:18.150 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-08-17T03:17:18.195 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-08-17T03:17:18.196 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-08-17T03:17:18.202 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2023-08-17T03:17:18.202 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-17T03:17:18.202 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2023-08-17T03:17:18.202 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2023-08-17T03:17:18.202 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-17T03:17:18.203 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="20.04" 2023-08-17T03:17:18.203 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-17T03:17:18.203 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-17T03:17:18.203 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-17T03:17:18.203 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-17T03:17:18.203 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=focal 2023-08-17T03:17:18.204 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=focal 2023-08-17T03:17:18.204 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-17T03:17:18.231 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-08-17T03:17:18.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-17T03:17:18.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T03:17:18.278 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-08-17T03:17:18.397 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-17T03:17:18.398 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-08-17T03:17:18.447 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-08-17T03:17:18.447 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-17T03:17:18.453 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-08-17T03:17:18.454 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-17T03:17:18.454 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-08-17T03:17:18.454 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-08-17T03:17:18.454 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-17T03:17:18.454 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="20.04" 2023-08-17T03:17:18.455 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-17T03:17:18.455 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-17T03:17:18.455 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-17T03:17:18.455 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-17T03:17:18.455 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=focal 2023-08-17T03:17:18.455 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=focal 2023-08-17T03:17:18.456 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-17T03:17:18.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:17:18.562 INFO:teuthology.dispatcher.supervisor:Running job 7371768 2023-08-17T03:17:18.563 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-08-17_03:08:10-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7371768 --name mchangir-2023-08-17_03:08:10-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-08-17_03:08:10-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7371768/orig.config.yaml 2023-08-17T03:17:18.566 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-08-17_03:08:10-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7371768 2023-08-17T03:17:18.567 INFO:teuthology.dispatcher.supervisor:Job PID: 20540 2023-08-17T03:17:18.567 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-17T03:19:18.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:21:18.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:23:18.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:25:19.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:27:19.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:29:19.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:31:19.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:33:19.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:35:19.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:37:20.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:39:20.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:41:20.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:43:20.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:45:20.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:47:20.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:49:21.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:51:21.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:53:21.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:55:21.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:57:21.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T03:59:21.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:01:22.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:03:22.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:05:22.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:07:22.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:09:22.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:11:23.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:13:23.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:15:23.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:17:23.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:19:23.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:21:23.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:23:23.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:25:24.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:27:24.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:29:24.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:31:24.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:33:24.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:35:25.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:37:25.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:39:25.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:41:25.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:43:25.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:45:25.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:47:25.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:49:26.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:51:26.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:53:26.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:55:26.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:57:26.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T04:59:27.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T05:01:27.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T05:03:27.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T05:05:27.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T05:07:27.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T05:07:27.888 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-17T05:07:28.104 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-17T05:07:28.105 INFO:teuthology.nuke:Checking targets against current locks 2023-08-17T05:07:28.152 DEBUG:teuthology.nuke:shortname: smithi141 2023-08-17T05:07:28.153 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T05:07:28.175 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-17_03:08:10-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7371768', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 03:10:44.840314', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-17T05:07:28.178 DEBUG:teuthology.nuke:shortname: smithi178 2023-08-17T05:07:28.178 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T05:07:28.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-08-17_03:08:10-fs-wip-mchangir-mgr-snap_schedule-make-fs-argument-mandatory-distro-default-smithi/7371768', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 03:10:44.842003', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-17T05:07:28.221 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-17T05:07:28.222 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T05:07:28.246 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-17T05:07:28.247 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T05:07:28.268 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-17T05:07:28.269 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T05:07:28.279 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-17T05:07:28.289 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-17T05:07:28.290 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T05:07:28.331 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-17T05:07:28.380 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-17T05:07:28.433 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-17T05:07:28.537 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2023-08-17T05:07:28.579 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com