2023-06-19T19:07:18.206 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-19T19:07:18.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:07:18.208 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:07:18.330 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb02abe23a0>, signals=[15]) 2023-06-19T19:07:18.331 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-06-19T19:07:18.332 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-06-19T19:07:18.332 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-06-19T19:07:18.357 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"} 2023-06-19T19:07:18.422 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-19T19:07:18.463 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-19T19:07:18.463 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 6} 2023-06-19T19:07:18.508 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of ubuntu 22.04 2023-06-19T19:07:18.509 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:07:18.588 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"} 2023-06-19T19:07:18.636 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1} 2023-06-19T19:07:18.701 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:07:18.815 INFO:teuthology.orchestra.console:Power off smithi138 2023-06-19T19:07:18.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-19T19:07:18.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T19:07:22.864 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T19:07:26.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T19:07:27.194 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2023-06-19T19:07:27.296 INFO:teuthology.orchestra.console:Power on smithi138 2023-06-19T19:07:27.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-19T19:07:27.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T19:07:31.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T19:07:35.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-19T19:07:35.662 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2023-06-19T19:07:35.763 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-06-19T19:07:35.763 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:07:50.844 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:08:05.928 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:08:21.015 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:08:36.084 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:08:51.172 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:09:06.256 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:09:21.340 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:09:36.424 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:09:51.516 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:10:06.612 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:10:21.696 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:10:36.796 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:10:51.916 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None 2023-06-19T19:10:52.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:10:55.096 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:11:01.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:11:04.176 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:11:10.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:11:13.236 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:11:19.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:11:22.320 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:11:28.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:11:31.376 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:11:37.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:11:40.432 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:11:46.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:12:18.033 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:12:24.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:12:24.038 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:12:30.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:12:30.046 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:12:36.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:12:36.055 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-06-19T19:12:42.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:12:42.332 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-19T19:12:42.334 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-19T19:12:42.807 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-06-19T19:12:42.807 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-06-19T19:12:42.860 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2023-06-19T19:12:42.861 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2023-06-19T19:12:42.909 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2023-06-19T19:12:42.909 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-06-19T19:12:43.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2023-06-19T19:12:43.075 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2023-06-19T19:12:43.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2023-06-19T19:12:43.187 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-06-19T19:12:43.243 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-06-19T19:12:43.297 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-19T19:12:43.297 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-06-19T19:12:43.297 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2023-06-19T19:12:43.297 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-19T19:12:43.298 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2023-06-19T19:12:43.298 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-06-19T19:12:43.298 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-06-19T19:12:43.298 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-19T19:12:43.298 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-19T19:12:43.299 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-19T19:12:43.299 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-19T19:12:43.299 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2023-06-19T19:12:43.299 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-06-19T19:12:43.302 DEBUG:teuthology.parallel:result is None 2023-06-19T19:12:43.433 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-06-19T19:12:43.434 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-19T19:12:43.457 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-06-19T19:12:43.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-06-19T19:12:43.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-19T19:12:43.579 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-06-19T19:12:43.690 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-06-19T19:12:43.736 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-06-19T19:12:43.737 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-06-19T19:12:43.783 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-19T19:12:43.783 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-19T19:12:43.784 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-19T19:12:43.785 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-19T19:12:43.785 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-19T19:12:43.785 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2023-06-19T19:12:43.786 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-06-19T19:12:43.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:12:43.806 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:12:44.108 INFO:teuthology.dispatcher.supervisor:Running job 7307721 2023-06-19T19:12:44.109 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-19_17:08:41-rados-wip-cbodley-testing-distro-default-smithi/7307721 --name yuriw-2023-06-19_17:08:41-rados-wip-cbodley-testing-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-06-19_17:08:41-rados-wip-cbodley-testing-distro-default-smithi/7307721/orig.config.yaml 2023-06-19T19:12:44.113 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-19_17:08:41-rados-wip-cbodley-testing-distro-default-smithi/7307721 2023-06-19T19:12:44.113 INFO:teuthology.dispatcher.supervisor:Job PID: 1797 2023-06-19T19:12:44.114 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-19T19:14:44.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:14:44.214 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:16:44.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:16:44.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:18:44.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:18:44.573 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:20:44.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:20:44.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:22:44.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:22:44.921 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:24:45.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:24:45.097 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:26:45.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:26:45.266 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:28:45.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:28:45.446 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:30:45.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:30:45.614 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:32:45.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-19T19:32:45.778 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-19T19:32:45.855 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-19T19:32:45.959 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-06-19T19:32:46.013 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com