2023-06-26T19:21:36.464 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T19:21:36.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:21:36.468 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:21:41.532 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12ca3818b0>, signals=[15]) 2023-06-26T19:21:41.533 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-06-26T19:21:41.534 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T19:21:41.534 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-06-26T19:21:41.551 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"} 2023-06-26T19:21:41.621 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-26T19:21:41.656 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-26T19:21:41.656 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 6} 2023-06-26T19:21:41.694 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04 2023-06-26T19:21:41.694 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:21:41.735 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T19:21:41.775 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1} 2023-06-26T19:21:41.825 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:21:41.912 INFO:teuthology.orchestra.console:Power off smithi098 2023-06-26T19:21:41.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T19:21:41.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:21:45.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:21:50.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:21:50.286 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-06-26T19:21:50.387 INFO:teuthology.orchestra.console:Power on smithi098 2023-06-26T19:21:50.388 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T19:21:50.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:21:54.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:21:58.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:03.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:08.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:13.887 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:18.999 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:24.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:29.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:34.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:39.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:44.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:49.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:54.787 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T19:22:54.998 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2023-06-26T19:22:55.099 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-06-26T19:22:55.099 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:23:20.196 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:23:40.085 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:24:00.200 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:24:20.244 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:24:40.360 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:24:55.456 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None 2023-06-26T19:25:00.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:25:08.592 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-26T19:25:14.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:25:22.672 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-26T19:25:28.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:25:36.752 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-26T19:25:42.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:25:50.832 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2023-06-26T19:25:56.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:26:58.304 WARNING:teuthology.provision.fog.smithi098:timed out 2023-06-26T19:27:04.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:27:04.591 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T19:27:04.594 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T19:27:04.986 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-06-26T19:27:04.987 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2023-06-26T19:27:05.031 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-06-26T19:27:05.032 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2023-06-26T19:27:05.080 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-06-26T19:27:05.080 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-06-26T19:27:05.222 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2023-06-26T19:27:05.237 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2023-06-26T19:27:05.292 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2023-06-26T19:27:05.348 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2023-06-26T19:27:05.402 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-06-26T19:27:05.451 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T19:27:05.451 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-06-26T19:27:05.452 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-06-26T19:27:05.452 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T19:27:05.452 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-06-26T19:27:05.452 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-06-26T19:27:05.452 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-06-26T19:27:05.453 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T19:27:05.453 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T19:27:05.453 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T19:27:05.453 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T19:27:05.453 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-06-26T19:27:05.454 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-06-26T19:27:05.455 DEBUG:teuthology.parallel:result is None 2023-06-26T19:27:25.597 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-06-26T19:27:25.598 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T19:27:30.627 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-06-26T19:27:30.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-06-26T19:27:30.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T19:27:35.708 DEBUG:teuthology.orchestra.run.smithi098:> true 2023-06-26T19:27:35.915 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2023-06-26T19:27:35.962 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-06-26T19:27:35.963 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2023-06-26T19:27:36.006 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Ubuntu" 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="22.04" 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_CODENAME=jammy 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:ID=ubuntu 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE=debian 2023-06-26T19:27:36.007 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T19:27:36.008 INFO:teuthology.orchestra.run.smithi098.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T19:27:36.008 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T19:27:36.008 INFO:teuthology.orchestra.run.smithi098.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T19:27:36.008 INFO:teuthology.orchestra.run.smithi098.stdout:UBUNTU_CODENAME=jammy 2023-06-26T19:27:36.008 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-06-26T19:27:40.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:27:40.766 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:27:40.877 INFO:teuthology.dispatcher.supervisor:Running job 7316792 2023-06-26T19:27:40.877 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316792 --name yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} -- /home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316792/orig.config.yaml 2023-06-26T19:27:40.882 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_18:56:05-rados-wip-yuri7-testing-2023-06-23-1022-distro-default-smithi/7316792 2023-06-26T19:27:40.883 INFO:teuthology.dispatcher.supervisor:Job PID: 20433 2023-06-26T19:27:40.883 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-26T19:29:40.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:29:40.985 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:31:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:31:46.166 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:33:50.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:33:50.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:35:55.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:35:55.722 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:38:00.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:38:00.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:40:06.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:40:06.098 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:42:11.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:42:11.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:44:16.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:44:16.458 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:46:16.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:46:16.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:48:21.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T19:48:21.794 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T19:48:22.838 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-26T19:48:22.915 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-06-26T19:48:22.962 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com