2023-06-29T18:34:54.424 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39
2023-06-29T18:34:54.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:34:54.426 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:34:54.552 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5b0f658640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5b0effb5e0>, signals=[15])
2023-06-29T18:34:54.553 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-06-29T18:34:54.554 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-06-29T18:34:54.554 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-06-29T18:34:54.579 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-06-29T18:34:54.650 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_ubuntu_22.04"}
2023-06-29T18:34:54.697 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-06-29T18:34:54.698 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 6}
2023-06-29T18:34:54.741 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 22.04
2023-06-29T18:34:54.741 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:34:54.812 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-06-29T18:34:54.851 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-06-29T18:34:54.920 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:34:55.020 INFO:teuthology.orchestra.console:Power off smithi099
2023-06-29T18:34:55.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-29T18:34:55.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T18:34:55.167 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2023-06-29T18:34:55.268 INFO:teuthology.orchestra.console:Power on smithi099
2023-06-29T18:34:55.269 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-29T18:34:55.289 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T18:34:59.314 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T18:34:59.526 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2023-06-29T18:34:59.627 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-06-29T18:34:59.628 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:35:14.710 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:35:29.800 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:35:44.892 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:35:59.992 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:36:15.090 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:36:30.184 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:36:45.263 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:37:00.348 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:37:15.440 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:37:30.528 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:37:45.604 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:38:00.681 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:38:15.764 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-06-29T18:38:15.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:38:18.896 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:38:24.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:38:27.952 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:38:33.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:38:37.008 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:38:43.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:38:46.064 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:38:52.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:38:55.124 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:39:01.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:39:04.212 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:39:10.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:39:13.296 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:39:19.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:39:37.841 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:39:43.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:39:46.896 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:39:52.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:39:52.903 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:39:58.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:39:58.913 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:40:04.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:40:04.921 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:40:10.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:40:10.926 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-06-29T18:40:16.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:40:17.234 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-29T18:40:17.236 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-29T18:40:18.109 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-06-29T18:40:18.109 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-06-29T18:40:18.155 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-06-29T18:40:18.155 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-06-29T18:40:18.203 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-06-29T18:40:18.203 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-06-29T18:40:18.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-06-29T18:40:18.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-06-29T18:40:18.426 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-06-29T18:40:18.478 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-06-29T18:40:18.533 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-06-29T18:40:18.578 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-06-29T18:40:18.579 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu"
2023-06-29T18:40:18.579 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04"
2023-06-29T18:40:18.579 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-06-29T18:40:18.579 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy
2023-06-29T18:40:18.579 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu
2023-06-29T18:40:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian
2023-06-29T18:40:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/"
2023-06-29T18:40:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-06-29T18:40:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-06-29T18:40:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-06-29T18:40:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy
2023-06-29T18:40:18.581 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-06-29T18:40:18.582 DEBUG:teuthology.parallel:result is None
2023-06-29T18:40:18.716 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-06-29T18:40:18.717 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-29T18:40:18.750 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-06-29T18:40:18.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-06-29T18:40:18.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-29T18:40:18.821 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-06-29T18:40:18.927 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-06-29T18:40:18.975 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-06-29T18:40:18.975 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-06-29T18:40:19.023 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-06-29T18:40:19.024 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu"
2023-06-29T18:40:19.024 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04"
2023-06-29T18:40:19.024 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-06-29T18:40:19.025 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy
2023-06-29T18:40:19.025 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu
2023-06-29T18:40:19.025 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian
2023-06-29T18:40:19.025 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/"
2023-06-29T18:40:19.026 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-06-29T18:40:19.026 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-06-29T18:40:19.026 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-06-29T18:40:19.026 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy
2023-06-29T18:40:19.027 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-06-29T18:40:19.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:40:19.058 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:40:19.164 INFO:teuthology.dispatcher.supervisor:Running job 7321837
2023-06-29T18:40:19.165 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321837 --name yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321837/orig.config.yaml
2023-06-29T18:40:19.170 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-29_15:47:19-rados-wip-yuri6-testing-2023-06-28-0739-reef-distro-default-smithi/7321837
2023-06-29T18:40:19.171 INFO:teuthology.dispatcher.supervisor:Job PID: 2052
2023-06-29T18:40:19.171 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-29T18:42:19.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:42:19.269 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:44:19.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:44:19.448 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:46:19.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:46:19.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:48:19.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:48:19.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:50:19.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:50:19.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:52:20.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:52:20.138 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:54:20.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:54:20.314 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:56:20.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:56:20.490 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T18:58:20.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T18:58:20.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:00:20.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T19:00:20.831 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T19:00:20.907 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-29T19:00:21.002 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2023-06-29T19:00:21.056 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com