2023-06-20T05:33:26.606 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-20T05:33:26.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T05:33:26.608 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T05:33:26.769 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f079400e8b0>, signals=[15]) 2023-06-20T05:33:26.771 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-06-20T05:33:26.771 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-06-20T05:33:26.771 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-06-20T05:33:26.795 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-06-20T05:33:26.877 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-20T05:33:26.919 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-20T05:33:26.919 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 2} 2023-06-20T05:33:26.968 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 20.04 2023-06-20T05:33:26.968 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:33:27.047 DEBUG:teuthology.provision.fog.smithi111:Canceling deploy task with ID 330654 2023-06-20T05:33:27.047 DEBUG:teuthology.provision.fog.smithi111:FOG request: DELETE /task/cancel {"id": 330654} 2023-06-20T05:33:27.134 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-06-20T05:33:27.183 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-06-20T05:33:27.244 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:33:27.362 INFO:teuthology.orchestra.console:Power off smithi111 2023-06-20T05:33:27.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-20T05:33:27.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T05:33:31.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T05:33:35.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T05:33:35.731 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-06-20T05:33:35.832 INFO:teuthology.orchestra.console:Power on smithi111 2023-06-20T05:33:35.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-20T05:33:35.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T05:33:39.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T05:33:43.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-20T05:33:44.196 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2023-06-20T05:33:44.297 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-06-20T05:33:44.297 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:33:59.392 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:34:14.506 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:34:29.600 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:34:44.708 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:34:59.792 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:35:14.888 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:35:29.972 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:35:45.064 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:36:00.158 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:36:15.264 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:36:30.364 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:36:45.476 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:37:00.560 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:37:15.644 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:37:30.720 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:37:45.790 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-06-20T05:37:45.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T05:38:45.908 WARNING:teuthology.provision.fog.smithi111:timed out 2023-06-20T05:38:51.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T05:38:52.948 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-06-20T05:38:58.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T05:39:59.016 WARNING:teuthology.provision.fog.smithi111:timed out 2023-06-20T05:40:05.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T05:40:05.131 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-20T05:40:05.142 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-20T05:40:05.655 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-06-20T05:40:05.655 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-06-20T05:40:05.662 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-06-20T05:40:05.662 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2023-06-20T05:40:05.669 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-06-20T05:40:05.669 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-06-20T05:40:05.751 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2023-06-20T05:40:05.766 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2023-06-20T05:40:05.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2023-06-20T05:40:05.842 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-06-20T05:40:05.856 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-06-20T05:40:05.861 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-06-20T05:40:05.861 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-20T05:40:05.861 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-06-20T05:40:05.861 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-06-20T05:40:05.861 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-20T05:40:05.861 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2023-06-20T05:40:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-20T05:40:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-20T05:40:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-20T05:40:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-20T05:40:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2023-06-20T05:40:05.862 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2023-06-20T05:40:05.863 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-06-20T05:40:05.864 DEBUG:teuthology.parallel:result is None 2023-06-20T05:40:06.033 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-06-20T05:40:06.034 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-20T05:40:06.055 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-06-20T05:40:06.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-06-20T05:40:06.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-20T05:40:06.107 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-06-20T05:40:06.226 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-06-20T05:40:06.232 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-06-20T05:40:06.233 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-06-20T05:40:06.237 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-06-20T05:40:06.237 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-20T05:40:06.237 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-06-20T05:40:06.237 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-20T05:40:06.238 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2023-06-20T05:40:06.239 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2023-06-20T05:40:06.239 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-06-20T05:40:06.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T05:40:06.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T05:40:06.376 INFO:teuthology.dispatcher.supervisor:Running job 7308548 2023-06-20T05:40:06.376 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-20_00:06:17-rados-wip-yuri3-testing-2023-06-19-1518-distro-default-smithi/7308548 --name yuriw-2023-06-20_00:06:17-rados-wip-yuri3-testing-2023-06-19-1518-distro-default-smithi --description rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_20.04}} -- /home/teuthworker/archive/yuriw-2023-06-20_00:06:17-rados-wip-yuri3-testing-2023-06-19-1518-distro-default-smithi/7308548/orig.config.yaml 2023-06-20T05:40:06.381 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-20_00:06:17-rados-wip-yuri3-testing-2023-06-19-1518-distro-default-smithi/7308548 2023-06-20T05:40:06.382 INFO:teuthology.dispatcher.supervisor:Job PID: 4068 2023-06-20T05:40:06.382 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-20T05:42:06.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-20T05:42:06.482 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-20T05:42:06.566 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-20T05:42:06.627 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-06-20_00:06:17-rados-wip-yuri3-testing-2023-06-19-1518-distro-default-smithi/7308559