2023-07-01T04:32:28.649 INFO:root:teuthology version: 0.0.1.dev138+g8dce2fc 2023-07-01T04:32:28.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:32:28.651 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:32:28.769 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9ad551670>, signals=[15]) 2023-07-01T04:32:28.770 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-07-01T04:32:28.771 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-07-01T04:32:28.771 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-07-01T04:32:28.794 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-07-01T04:32:28.860 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-01T04:32:28.898 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-01T04:32:28.898 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 6} 2023-07-01T04:32:28.945 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 22.04 2023-07-01T04:32:28.945 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:32:29.014 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-07-01T04:32:29.052 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-07-01T04:32:29.107 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:32:29.205 INFO:teuthology.orchestra.console:Power off smithi141 2023-07-01T04:32:29.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-01T04:32:29.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T04:32:33.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T04:32:37.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T04:32:41.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T04:32:41.701 INFO:teuthology.orchestra.console:Power off for smithi141 completed 2023-07-01T04:32:41.802 INFO:teuthology.orchestra.console:Power on smithi141 2023-07-01T04:32:41.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-01T04:32:41.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T04:32:45.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-01T04:32:46.058 INFO:teuthology.orchestra.console:Power on for smithi141 completed 2023-07-01T04:32:46.160 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-07-01T04:32:46.160 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:33:01.232 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:33:16.308 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:33:31.400 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:33:46.493 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:34:01.592 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:34:16.692 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:34:31.780 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:34:46.868 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:35:01.964 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:35:17.064 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:35:32.160 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:35:47.256 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:36:02.372 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-07-01T04:36:02.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:36:05.524 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-01T04:36:11.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:36:14.608 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-01T04:36:20.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:36:23.664 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-01T04:36:29.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:36:32.720 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-01T04:36:38.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:36:41.780 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-01T04:36:47.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:36:50.864 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-07-01T04:36:56.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:37:56.928 WARNING:teuthology.provision.fog.smithi141:timed out 2023-07-01T04:38:02.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:38:03.114 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-01T04:38:03.115 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-01T04:38:03.572 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-07-01T04:38:03.573 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-07-01T04:38:03.617 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com 2023-07-01T04:38:03.618 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts 2023-07-01T04:38:03.665 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-07-01T04:38:03.666 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-07-01T04:38:03.790 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts 2023-07-01T04:38:03.804 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-07-01T04:38:03.862 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname 2023-07-01T04:38:03.918 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-07-01T04:38:03.973 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-07-01T04:38:04.021 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-01T04:38:04.022 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2023-07-01T04:38:04.022 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="22.04" 2023-07-01T04:38:04.022 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-01T04:38:04.022 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=jammy 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-01T04:38:04.023 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=jammy 2023-07-01T04:38:04.024 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-07-01T04:38:04.026 DEBUG:teuthology.parallel:result is None 2023-07-01T04:38:04.158 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-07-01T04:38:04.159 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-01T04:38:04.191 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-07-01T04:38:04.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-07-01T04:38:04.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-01T04:38:04.270 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-07-01T04:38:04.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-07-01T04:38:04.372 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-07-01T04:38:04.416 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-07-01T04:38:04.417 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-07-01T04:38:04.465 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-01T04:38:04.466 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Ubuntu" 2023-07-01T04:38:04.466 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="22.04" 2023-07-01T04:38:04.466 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-01T04:38:04.466 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_CODENAME=jammy 2023-07-01T04:38:04.466 INFO:teuthology.orchestra.run.smithi141.stdout:ID=ubuntu 2023-07-01T04:38:04.466 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE=debian 2023-07-01T04:38:04.467 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-01T04:38:04.467 INFO:teuthology.orchestra.run.smithi141.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-01T04:38:04.467 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-01T04:38:04.467 INFO:teuthology.orchestra.run.smithi141.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-01T04:38:04.467 INFO:teuthology.orchestra.run.smithi141.stdout:UBUNTU_CODENAME=jammy 2023-07-01T04:38:04.467 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-07-01T04:38:04.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:38:04.490 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:38:04.596 INFO:teuthology.dispatcher.supervisor:Running job 7323679 2023-07-01T04:38:04.596 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8dce2fc6417e1b191b069043fa417c11b1882785/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323679 --name yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} -- /home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323679/orig.config.yaml 2023-07-01T04:38:04.599 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-30_21:59:48-rados-reef-distro-default-smithi/7323679 2023-07-01T04:38:04.600 INFO:teuthology.dispatcher.supervisor:Job PID: 6985 2023-07-01T04:38:04.600 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-01T04:40:04.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:40:04.701 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:42:04.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:42:04.868 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:44:05.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:44:05.047 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:46:05.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:46:05.219 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:48:05.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:48:05.402 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:50:05.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:50:05.574 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:52:05.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:52:05.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:54:05.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:54:05.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:56:06.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-01T04:56:06.101 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-01T04:56:06.179 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-01T04:56:06.265 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-07-01T04:56:06.319 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com