2023-07-26T07:04:06.135 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T07:04:06.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:04:06.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:04:06.290 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a1352f550>, signals=[15]) 2023-07-26T07:04:06.291 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-07-26T07:04:06.292 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T07:04:06.292 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-26T07:04:06.314 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-07-26T07:04:06.315 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T07:04:06.315 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-26T07:04:06.316 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-07-26T07:04:06.339 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-07-26T07:04:06.390 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-26T07:04:06.409 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-26T07:04:06.425 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-26T07:04:06.425 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 6} 2023-07-26T07:04:06.461 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-26T07:04:06.461 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 6} 2023-07-26T07:04:06.475 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of ubuntu 22.04 2023-07-26T07:04:06.476 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:04:06.510 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 22.04 2023-07-26T07:04:06.510 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:04:06.512 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T07:04:06.543 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-07-26T07:04:06.551 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T07:04:06.582 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-07-26T07:04:06.598 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:04:06.629 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:04:06.684 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-26T07:04:06.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T07:04:06.698 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-26T07:04:06.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T07:04:06.706 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T07:04:06.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:06.717 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T07:04:06.718 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:06.726 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:06.737 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:10.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:10.738 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:10.838 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:10.847 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:14.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:14.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:14.953 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:14.961 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:18.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:18.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:19.066 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T07:04:19.073 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T07:04:19.167 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-26T07:04:19.174 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-26T07:04:19.268 INFO:teuthology.orchestra.console:Power on smithi006 2023-07-26T07:04:19.269 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T07:04:19.276 INFO:teuthology.orchestra.console:Power on smithi026 2023-07-26T07:04:19.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T07:04:19.289 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T07:04:19.290 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:19.300 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T07:04:19.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:19.312 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T07:04:19.320 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T07:04:23.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:23.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T07:04:23.423 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:23.430 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T07:04:23.525 INFO:teuthology.orchestra.console:Power on for smithi006 completed 2023-07-26T07:04:23.531 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2023-07-26T07:04:23.626 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-07-26T07:04:23.627 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:04:23.633 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-07-26T07:04:23.633 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:04:38.692 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:04:38.694 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:04:53.763 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:04:53.764 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:05:08.832 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:05:08.833 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:05:23.897 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:05:23.898 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:05:38.953 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:05:38.954 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:05:54.020 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:05:54.022 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:06:09.080 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:06:09.082 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:06:24.140 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:06:24.142 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:06:39.214 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:06:39.216 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:06:54.277 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:06:54.278 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:07:09.342 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:07:09.343 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:07:24.402 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-07-26T07:07:24.403 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-07-26T07:07:24.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:07:24.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:07:24.532 ERROR:teuthology.orchestra.connection:Error authenticating with smithi006.front.sepia.ceph.com: Authentication failed. 2023-07-26T07:07:24.534 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T07:07:24.535 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T07:07:24.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T07:07:27.504 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-26T07:07:33.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:07:36.560 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-26T07:07:42.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:07:45.616 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-26T07:07:51.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:07:54.672 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-26T07:08:00.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:08:03.728 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-07-26T07:08:09.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:09:09.731 WARNING:teuthology.provision.fog.smithi026:timed out 2023-07-26T07:09:15.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:09:15.765 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-26T07:09:15.766 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi006 2023-07-26T07:09:15.913 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T07:09:15.913 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T07:09:16.326 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-07-26T07:09:16.326 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-07-26T07:09:16.372 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-07-26T07:09:16.373 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-07-26T07:09:16.424 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-07-26T07:09:16.425 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-26T07:09:16.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-07-26T07:09:16.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-07-26T07:09:16.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-07-26T07:09:16.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-07-26T07:09:16.735 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-26T07:09:16.785 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-26T07:09:16.786 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-07-26T07:09:16.786 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2023-07-26T07:09:16.786 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-26T07:09:16.786 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T07:09:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2023-07-26T07:09:16.788 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-07-26T07:09:16.789 DEBUG:teuthology.parallel:result is None 2023-07-26T07:09:24.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-26T07:09:24.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:09:24.768 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-26T07:09:33.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-26T07:09:33.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:09:33.964 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-26T07:09:34.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-26T07:09:34.445 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T07:09:34.445 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T07:09:34.491 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-07-26T07:09:34.492 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-07-26T07:09:34.540 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-07-26T07:09:34.540 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-07-26T07:09:34.592 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-07-26T07:09:34.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-07-26T07:09:34.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-07-26T07:09:34.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-07-26T07:09:34.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-07-26T07:09:34.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-07-26T07:09:34.940 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-26T07:09:34.992 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-26T07:09:34.992 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2023-07-26T07:09:34.992 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T07:09:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T07:09:34.994 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T07:09:34.994 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2023-07-26T07:09:34.994 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-07-26T07:09:34.995 DEBUG:teuthology.parallel:result is None 2023-07-26T07:09:35.162 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-07-26T07:09:35.162 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T07:09:35.187 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-07-26T07:09:35.187 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T07:09:35.213 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-07-26T07:09:35.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-26T07:09:35.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:09:35.289 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-26T07:09:35.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-26T07:09:35.381 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-07-26T07:09:35.428 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-07-26T07:09:35.428 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-26T07:09:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-26T07:09:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2023-07-26T07:09:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2023-07-26T07:09:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-26T07:09:35.476 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T07:09:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2023-07-26T07:09:35.478 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-26T07:09:35.504 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-07-26T07:09:35.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-26T07:09:35.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T07:09:35.577 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-07-26T07:09:35.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-07-26T07:09:35.688 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-07-26T07:09:35.733 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-07-26T07:09:35.733 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-07-26T07:09:35.781 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-26T07:09:35.781 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2023-07-26T07:09:35.781 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2023-07-26T07:09:35.781 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-26T07:09:35.781 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T07:09:35.782 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2023-07-26T07:09:35.783 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-07-26T07:09:35.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:09:35.804 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:09:35.894 INFO:teuthology.dispatcher.supervisor:Running job 7352573 2023-07-26T07:09:35.894 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352573 --name vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352573/orig.config.yaml 2023-07-26T07:09:35.898 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352573 2023-07-26T07:09:35.899 INFO:teuthology.dispatcher.supervisor:Job PID: 17428 2023-07-26T07:09:35.899 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T07:11:35.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:11:35.996 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:13:36.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:13:36.171 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:15:36.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:15:36.351 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:17:51.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:17:51.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:19:56.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:19:56.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:22:01.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:22:01.898 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:24:05.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:24:05.691 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:26:08.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:26:08.238 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:28:08.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:28:08.413 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:30:09.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:30:09.387 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:32:09.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:32:09.564 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:34:11.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:34:11.697 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:36:16.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:36:16.907 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:38:22.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:38:22.198 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:40:27.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:40:27.386 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:42:27.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:42:27.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:44:27.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:44:27.737 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:46:27.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:46:27.914 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:48:28.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:48:28.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:50:28.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:50:28.273 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:52:28.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:52:28.445 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:54:28.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:54:28.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:56:28.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:56:28.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T07:58:28.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T07:58:28.967 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:00:29.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T08:00:29.134 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:02:29.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T08:02:29.309 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:04:29.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T08:04:29.485 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:06:29.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T08:06:29.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:08:29.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T08:08:29.847 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:10:30.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T08:10:30.014 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T08:10:35.092 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T08:10:45.276 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T08:10:45.277 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T08:10:45.327 DEBUG:teuthology.nuke:shortname: smithi006 2023-07-26T08:10:45.327 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T08:10:45.348 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 07:04:05.224144', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK6oU+DjBRaPnw24MojX/IJvs5LBtxfzSE67idzmKiV2'} 2023-07-26T08:10:45.351 DEBUG:teuthology.nuke:shortname: smithi026 2023-07-26T08:10:45.351 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T08:10:45.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-26_04:54:56-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7352573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 07:04:05.222752', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBq3ySEdqzYVPc2tvK8eIZuJodKfOG3fi42uo1bcwHWpf37XiHAsvl4NCYkmVG3+/DircqcS5Pf646zWWzG+VQc='} 2023-07-26T08:10:45.407 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-26T08:10:45.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T08:10:45.433 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T08:10:45.434 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T08:10:45.450 INFO:teuthology.orchestra.console:Power off smithi026 2023-07-26T08:10:45.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T08:10:45.463 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T08:10:45.475 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T08:10:45.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T08:10:45.504 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T08:10:45.564 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-26T08:10:45.606 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2023-07-26T08:10:45.723 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-07-26T08:10:45.764 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com