2023-06-23T23:46:42.742 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T23:46:42.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T23:46:42.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T23:46:42.863 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4249ab18b0>, signals=[15]) 2023-06-23T23:46:42.865 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-06-23T23:46:42.865 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-06-23T23:46:42.866 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-06-23T23:46:42.903 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-06-23T23:46:42.980 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-23T23:46:43.017 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-23T23:46:43.018 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 2} 2023-06-23T23:46:43.065 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of ubuntu 20.04 2023-06-23T23:46:43.065 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:46:43.139 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-06-23T23:46:43.176 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-06-23T23:46:43.246 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:46:43.343 INFO:teuthology.orchestra.console:Power off smithi088 2023-06-23T23:46:43.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T23:46:43.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T23:46:47.389 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T23:46:51.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T23:46:51.710 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-06-23T23:46:51.811 INFO:teuthology.orchestra.console:Power on smithi088 2023-06-23T23:46:51.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-23T23:46:51.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T23:46:55.860 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T23:46:59.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T23:47:00.183 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2023-06-23T23:47:00.285 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-06-23T23:47:00.285 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:47:15.361 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:47:30.436 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:47:45.512 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:48:00.584 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:48:15.660 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:48:30.732 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:48:45.800 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:49:00.868 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:49:15.936 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:49:31.000 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:49:46.064 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:50:01.126 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:50:16.191 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:50:31.257 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:50:46.320 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:51:01.385 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-23T23:51:01.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:51:19.920 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-23T23:51:25.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:51:28.976 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-23T23:51:34.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:51:38.032 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-23T23:51:44.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:51:47.088 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-23T23:51:53.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:51:56.148 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-23T23:52:02.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:53:02.212 WARNING:teuthology.provision.fog.smithi088:timed out 2023-06-23T23:53:08.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:53:08.429 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-23T23:53:08.431 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-23T23:53:08.918 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-06-23T23:53:08.919 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-06-23T23:53:08.925 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-06-23T23:53:08.925 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-06-23T23:53:08.932 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-06-23T23:53:08.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-06-23T23:53:09.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-06-23T23:53:09.066 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-06-23T23:53:09.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-06-23T23:53:09.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-06-23T23:53:09.155 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-06-23T23:53:09.202 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-06-23T23:53:09.202 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T23:53:09.203 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-06-23T23:53:09.203 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-06-23T23:53:09.203 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T23:53:09.203 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="20.04" 2023-06-23T23:53:09.204 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T23:53:09.204 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T23:53:09.204 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T23:53:09.204 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T23:53:09.204 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=focal 2023-06-23T23:53:09.205 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=focal 2023-06-23T23:53:09.206 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-06-23T23:53:09.207 DEBUG:teuthology.parallel:result is None 2023-06-23T23:53:09.414 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-06-23T23:53:09.414 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-23T23:53:09.440 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-06-23T23:53:09.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-06-23T23:53:09.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T23:53:09.489 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-06-23T23:53:09.609 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-06-23T23:53:09.616 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-06-23T23:53:09.616 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-06-23T23:53:09.621 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="20.04" 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T23:53:09.622 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T23:53:09.623 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T23:53:09.623 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T23:53:09.623 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=focal 2023-06-23T23:53:09.623 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=focal 2023-06-23T23:53:09.624 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-06-23T23:53:09.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T23:53:09.647 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T23:53:09.746 INFO:teuthology.dispatcher.supervisor:Running job 7314216 2023-06-23T23:53:09.747 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-23_20:51:14-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7314216 --name yuriw-2023-06-23_20:51:14-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-06-23_20:51:14-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7314216/orig.config.yaml 2023-06-23T23:53:09.750 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-23_20:51:14-rados-wip-yuri8-testing-2023-06-22-1309-pacific-distro-default-smithi/7314216 2023-06-23T23:53:09.751 INFO:teuthology.dispatcher.supervisor:Job PID: 738 2023-06-23T23:53:09.751 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-23T23:55:09.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T23:55:09.849 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T23:57:10.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T23:57:10.022 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-23T23:59:10.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T23:59:10.195 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:01:10.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T00:01:10.369 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:03:10.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T00:03:10.569 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:05:10.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T00:05:10.750 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:07:10.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T00:07:10.918 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:09:11.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T00:09:11.089 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:11:11.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-24T00:11:11.255 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-24T00:11:11.330 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-24T00:11:11.411 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-06-24T00:11:11.462 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com