2023-07-10T10:54:53.292 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-10T10:54:53.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T10:54:53.293 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T10:54:53.441 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe3d5db3d30>, signals=[15]) 2023-07-10T10:54:53.442 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-07-10T10:54:53.443 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T10:54:53.443 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-10T10:54:53.465 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-07-10T10:54:53.465 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-07-10T10:54:53.466 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-07-10T10:54:53.467 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-07-10T10:54:53.490 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-07-10T10:54:53.540 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-10T10:54:53.567 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-10T10:54:53.578 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-10T10:54:53.578 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 2} 2023-07-10T10:54:53.603 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-10T10:54:53.604 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 2} 2023-07-10T10:54:53.623 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of ubuntu 20.04 2023-07-10T10:54:53.623 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:54:53.648 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of ubuntu 20.04 2023-07-10T10:54:53.648 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:54:53.706 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T10:54:53.709 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-07-10T10:54:53.741 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-07-10T10:54:53.744 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-07-10T10:54:53.795 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:54:53.833 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:54:53.911 INFO:teuthology.orchestra.console:Power off smithi023 2023-07-10T10:54:53.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T10:54:53.929 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-10T10:54:53.930 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T10:54:53.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:54:53.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:54:57.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:54:57.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:02.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:02.086 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:02.289 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2023-07-10T10:55:02.296 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-10T10:55:02.391 INFO:teuthology.orchestra.console:Power on smithi023 2023-07-10T10:55:02.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T10:55:02.400 INFO:teuthology.orchestra.console:Power on smithi012 2023-07-10T10:55:02.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-10T10:55:02.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:02.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:06.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:06.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:10.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:10.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T10:55:10.771 INFO:teuthology.orchestra.console:Power on for smithi012 completed 2023-07-10T10:55:10.864 INFO:teuthology.orchestra.console:Power on for smithi023 completed 2023-07-10T10:55:10.872 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-07-10T10:55:10.872 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:55:10.966 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-07-10T10:55:10.966 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:55:26.010 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:55:26.082 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:55:41.144 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:55:41.200 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:55:56.280 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:55:56.317 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:56:11.417 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:56:11.430 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:56:26.554 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:56:26.555 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:56:41.690 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:56:41.691 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:56:56.874 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:56:56.875 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:57:12.080 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:57:12.081 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:57:27.259 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:57:27.260 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:57:42.443 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:57:42.444 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:57:57.607 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:57:57.608 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:58:12.771 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:58:12.772 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:58:27.937 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:58:27.939 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:58:43.110 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:58:43.112 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-10T10:58:43.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T10:58:58.288 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:59:01.616 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-10T10:59:07.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T10:59:10.672 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-10T10:59:13.446 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:59:16.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T10:59:19.728 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-10T10:59:25.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T10:59:28.601 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:59:43.731 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T10:59:58.852 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T11:00:13.965 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T11:00:25.747 WARNING:teuthology.provision.fog.smithi012:timed out 2023-07-10T11:00:29.079 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-07-10T11:00:29.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T11:00:29.261 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: Authentication failed. 2023-07-10T11:00:29.263 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T11:00:29.264 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T11:00:29.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-10T11:00:30.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-10T11:00:31.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T11:00:31.947 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T11:00:31.947 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T11:00:32.446 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-07-10T11:00:32.447 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-07-10T11:00:32.452 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-07-10T11:00:32.453 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-07-10T11:00:32.460 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-07-10T11:00:32.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-10T11:00:32.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-07-10T11:00:32.584 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-07-10T11:00:32.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-07-10T11:00:32.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-10T11:00:32.666 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-10T11:00:32.670 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-07-10T11:00:32.670 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-10T11:00:32.670 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-07-10T11:00:32.670 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-10T11:00:32.671 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2023-07-10T11:00:32.672 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2023-07-10T11:00:32.672 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-07-10T11:00:32.673 DEBUG:teuthology.parallel:result is None 2023-07-10T11:04:06.000 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-10T11:04:06.001 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi023 2023-07-10T11:04:15.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-10T11:04:15.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T11:04:15.326 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-10T11:04:15.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-10T11:04:15.866 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-10T11:04:15.866 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-10T11:04:15.871 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-07-10T11:04:15.872 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-07-10T11:04:15.877 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-07-10T11:04:15.878 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-07-10T11:04:15.884 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-07-10T11:04:15.885 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-07-10T11:04:16.019 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-07-10T11:04:16.035 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-07-10T11:04:16.051 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-07-10T11:04:16.067 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-07-10T11:04:16.080 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-07-10T11:04:16.084 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2023-07-10T11:04:16.084 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-10T11:04:16.084 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2023-07-10T11:04:16.084 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2023-07-10T11:04:16.084 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-10T11:04:16.084 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="20.04" 2023-07-10T11:04:16.085 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-10T11:04:16.085 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-10T11:04:16.085 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-10T11:04:16.085 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-10T11:04:16.085 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=focal 2023-07-10T11:04:16.085 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=focal 2023-07-10T11:04:16.085 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-07-10T11:04:16.086 DEBUG:teuthology.parallel:result is None 2023-07-10T11:04:16.348 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-07-10T11:04:16.349 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-07-10T11:04:16.349 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-10T11:04:16.374 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-07-10T11:04:16.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-10T11:04:16.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T11:04:16.422 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-07-10T11:04:16.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-10T11:04:16.634 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-07-10T11:04:16.639 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-07-10T11:04:16.640 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-10T11:04:16.646 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-07-10T11:04:16.646 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-10T11:04:16.646 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-07-10T11:04:16.646 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-07-10T11:04:16.646 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-10T11:04:16.646 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2023-07-10T11:04:16.647 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-10T11:04:16.647 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-10T11:04:16.647 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-10T11:04:16.647 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-10T11:04:16.647 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2023-07-10T11:04:16.647 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2023-07-10T11:04:16.648 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-10T11:04:16.671 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-07-10T11:04:16.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-10T11:04:16.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-10T11:04:16.719 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-07-10T11:04:16.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-07-10T11:04:16.838 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-07-10T11:04:16.844 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-07-10T11:04:16.844 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-07-10T11:04:16.850 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2023-07-10T11:04:16.850 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-10T11:04:16.850 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2023-07-10T11:04:16.850 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2023-07-10T11:04:16.850 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="20.04" 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=focal 2023-07-10T11:04:16.851 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=focal 2023-07-10T11:04:16.852 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-07-10T11:04:16.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:04:16.881 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:04:16.987 INFO:teuthology.dispatcher.supervisor:Running job 7332022 2023-07-10T11:04:16.987 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-07-10_10:53:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7332022 --name prsrivas-2023-07-10_10:53:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_20.04} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/prsrivas-2023-07-10_10:53:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7332022/orig.config.yaml 2023-07-10T11:04:16.990 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-07-10_10:53:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7332022 2023-07-10T11:04:16.991 INFO:teuthology.dispatcher.supervisor:Job PID: 30462 2023-07-10T11:04:16.991 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-10T11:06:17.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:06:17.093 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:08:17.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:08:17.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:10:17.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:10:17.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:12:17.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:12:17.611 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:14:17.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:14:17.789 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:16:17.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:16:17.962 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:18:18.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:18:18.133 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:20:18.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:20:18.305 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:22:18.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:22:18.477 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:24:18.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:24:18.654 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:26:18.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:26:18.834 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:28:19.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:28:19.014 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:30:19.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-10T11:30:19.187 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-10T11:30:19.261 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-10T11:30:19.416 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-10T11:30:19.436 INFO:teuthology.nuke:Checking targets against current locks 2023-07-10T11:30:19.495 DEBUG:teuthology.nuke:shortname: smithi012 2023-07-10T11:30:19.496 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T11:30:19.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-10_10:53:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7332022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 10:54:52.484116', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-10T11:30:19.523 DEBUG:teuthology.nuke:shortname: smithi023 2023-07-10T11:30:19.523 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-10T11:30:19.543 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-10_10:53:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7332022', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 10:54:52.486015', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-10T11:30:19.573 INFO:teuthology.orchestra.console:Power off smithi012 2023-07-10T11:30:19.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T11:30:19.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T11:30:19.607 INFO:teuthology.orchestra.console:Power off smithi023 2023-07-10T11:30:19.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-10T11:30:19.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-10T11:30:19.718 INFO:teuthology.orchestra.console:Power off for smithi012 completed 2023-07-10T11:30:19.751 INFO:teuthology.orchestra.console:Power off for smithi023 completed 2023-07-10T11:30:19.868 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-07-10T11:30:19.901 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com