2023-06-26T15:51:51.305 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-26T15:51:51.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T15:51:51.307 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T15:52:01.101 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84864938b0>, signals=[15]) 2023-06-26T15:52:01.102 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging 2023-06-26T15:52:01.103 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server 2023-06-26T15:52:01.103 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-26T15:52:05.207 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /host {"name": "smithi052"} 2023-06-26T15:52:25.291 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-26T15:52:30.347 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-26T15:52:30.348 DEBUG:teuthology.provision.fog.smithi052:FOG request: PUT /host/157 {"imageID": 6} 2023-06-26T15:52:34.551 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of ubuntu 22.04 2023-06-26T15:52:34.552 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:52:34.620 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /tasktype {"name": "deploy"} 2023-06-26T15:52:34.658 DEBUG:teuthology.provision.fog.smithi052:FOG request: POST /host/157/task {"taskTypeID": 1} 2023-06-26T15:52:34.704 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:52:39.809 INFO:teuthology.orchestra.console:Power off smithi052 2023-06-26T15:52:39.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T15:52:39.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:52:43.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:52:47.983 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:52:53.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:52:58.207 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:52:58.419 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2023-06-26T15:52:58.520 INFO:teuthology.orchestra.console:Power on smithi052 2023-06-26T15:52:58.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-26T15:52:58.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:02.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:07.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:12.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:17.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:23.007 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:28.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:33.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T15:53:33.442 INFO:teuthology.orchestra.console:Power on for smithi052 completed 2023-06-26T15:53:33.543 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish 2023-06-26T15:53:33.543 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:53:53.628 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:54:13.712 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:54:33.792 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:54:53.884 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:55:13.826 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:55:33.900 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:55:48.983 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:56:06.407 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None 2023-06-26T15:56:11.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:56:19.536 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-26T15:56:25.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:56:28.592 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-26T15:56:34.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:56:37.648 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-26T15:56:43.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:56:46.704 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-26T15:56:52.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:56:55.760 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52 2023-06-26T15:57:01.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:58:01.824 WARNING:teuthology.provision.fog.smithi052:timed out 2023-06-26T15:58:07.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:58:13.025 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-26T15:58:13.026 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-26T15:58:13.482 INFO:teuthology.provision.fog.smithi052:Node is ready 2023-06-26T15:58:13.483 DEBUG:teuthology.orchestra.run.smithi052:> hostname 2023-06-26T15:58:13.531 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com 2023-06-26T15:58:13.531 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts 2023-06-26T15:58:13.580 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052 2023-06-26T15:58:13.580 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-06-26T15:58:13.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts 2023-06-26T15:58:13.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts 2023-06-26T15:58:13.776 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname 2023-06-26T15:58:13.831 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052 2023-06-26T15:58:13.886 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-06-26T15:58:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T15:58:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2023-06-26T15:58:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04" 2023-06-26T15:58:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T15:58:13.935 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T15:58:13.936 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy 2023-06-26T15:58:13.938 INFO:teuthology.provision.fog.smithi052:Deploy complete! 2023-06-26T15:58:13.939 DEBUG:teuthology.parallel:result is None 2023-06-26T15:58:16.428 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com 2023-06-26T15:58:16.429 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-26T15:58:16.454 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server 2023-06-26T15:58:16.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-06-26T15:58:16.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-26T15:58:16.533 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-06-26T15:58:16.624 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-06-26T15:58:16.670 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-06-26T15:58:16.670 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-06-26T15:58:16.719 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-26T15:58:16.719 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2023-06-26T15:58:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="22.04" 2023-06-26T15:58:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-26T15:58:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=jammy 2023-06-26T15:58:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2023-06-26T15:58:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2023-06-26T15:58:16.720 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-26T15:58:16.721 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-26T15:58:16.721 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-26T15:58:16.721 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-26T15:58:16.721 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=jammy 2023-06-26T15:58:16.721 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-26T15:58:21.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T15:58:21.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T15:58:26.848 INFO:teuthology.dispatcher.supervisor:Running job 7316491 2023-06-26T15:58:26.848 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316491 --name yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316491/orig.config.yaml 2023-06-26T15:58:26.852 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316491 2023-06-26T15:58:26.853 INFO:teuthology.dispatcher.supervisor:Job PID: 22684 2023-06-26T15:58:26.853 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-26T16:00:26.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T16:00:26.955 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T16:02:32.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T16:02:32.132 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T16:04:35.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T16:04:35.413 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T16:06:37.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T16:06:37.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T16:08:42.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-26T16:08:42.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-26T16:08:42.639 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-26T16:08:42.749 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-26T16:08:42.749 INFO:teuthology.nuke:Checking targets against current locks 2023-06-26T16:08:42.801 DEBUG:teuthology.nuke:shortname: smithi052 2023-06-26T16:08:42.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-26T16:08:42.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_14:30:03-rados-wip-yuri-testing-2023-06-23-0831-distro-default-smithi/7316491', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-26 15:51:40.516478', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEijCXjzKsXTb5yTQCeE3C8aPUvB4/OpbXxdpAM+ULtBclN1IovKNDcrtatIu8beVG/3AyByFjHymF0A0eDfmPI='} 2023-06-26T16:08:42.884 INFO:teuthology.orchestra.console:Power off smithi052 2023-06-26T16:08:42.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-26T16:08:42.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-26T16:08:43.032 INFO:teuthology.orchestra.console:Power off for smithi052 completed 2023-06-26T16:08:43.197 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com