2023-07-17T22:02:03.453 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-17T22:02:03.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:02:03.455 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:02:13.588 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa5c1f166a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa5c18a5820>, signals=[15])
2023-07-17T22:02:13.590 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2023-07-17T22:02:13.591 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2023-07-17T22:02:13.591 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-07-17T22:02:13.617 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /host {"name": "smithi100"}
2023-07-17T22:02:13.688 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /image {"name": "smithi_ubuntu_20.04"}
2023-07-17T22:02:13.733 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_ubuntu_20.04 (ID 2)
2023-07-17T22:02:13.733 DEBUG:teuthology.provision.fog.smithi100:FOG request: PUT /host/205 {"imageID": 2}
2023-07-17T22:02:13.780 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 20.04
2023-07-17T22:02:13.781 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:02:13.839 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /tasktype {"name": "deploy"}
2023-07-17T22:02:13.874 DEBUG:teuthology.provision.fog.smithi100:FOG request: POST /host/205/task {"taskTypeID": 1}
2023-07-17T22:02:13.925 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:02:14.033 INFO:teuthology.orchestra.console:Power off smithi100
2023-07-17T22:02:14.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T22:02:14.074 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:18.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:23.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:28.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:28.532 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2023-07-17T22:02:28.633 INFO:teuthology.orchestra.console:Power on smithi100
2023-07-17T22:02:28.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-17T22:02:43.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:48.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:53.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:02:54.001 INFO:teuthology.orchestra.console:Power on for smithi100 completed
2023-07-17T22:02:54.102 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2023-07-17T22:02:54.103 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:03:14.202 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:03:34.304 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:03:53.836 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:04:08.932 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:04:28.812 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:04:48.424 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:05:08.532 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:05:28.665 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:05:43.782 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:06:03.907 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:06:24.052 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:06:44.152 DEBUG:teuthology.provision.fog.smithi100:FOG request: GET /task/active None
2023-07-17T22:06:44.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:06:47.888 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-07-17T22:06:53.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:06:56.944 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-07-17T22:07:02.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:07:11.028 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-07-17T22:07:17.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:07:20.112 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-07-17T22:07:26.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:07:49.620 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-07-17T22:07:55.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:08:03.696 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2023-07-17T22:08:09.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:08:14.909 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-17T22:08:14.910 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-17T22:08:35.454 INFO:teuthology.provision.fog.smithi100:Node is ready
2023-07-17T22:08:35.454 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2023-07-17T22:08:35.461 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com
2023-07-17T22:08:35.461 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts
2023-07-17T22:08:35.468 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100
2023-07-17T22:08:35.468 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2023-07-17T22:08:35.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts
2023-07-17T22:08:35.622 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2023-07-17T22:08:35.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname
2023-07-17T22:08:35.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2023-07-17T22:08:35.712 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2023-07-17T22:08:35.717 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04"
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-17T22:08:35.718 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-17T22:08:35.719 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-17T22:08:35.719 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-17T22:08:35.719 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal
2023-07-17T22:08:35.719 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal
2023-07-17T22:08:35.720 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2023-07-17T22:08:35.721 DEBUG:teuthology.parallel:result is None
2023-07-17T22:08:36.583 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com
2023-07-17T22:08:36.584 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-17T22:08:36.612 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server
2023-07-17T22:08:36.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com'
2023-07-17T22:08:36.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T22:08:36.665 DEBUG:teuthology.orchestra.run.smithi100:> true
2023-07-17T22:08:36.787 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com'
2023-07-17T22:08:36.787 DEBUG:teuthology.orchestra.run.smithi100:> uname -m
2023-07-17T22:08:36.835 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64
2023-07-17T22:08:36.836 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2023-07-17T22:08:36.842 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2023-07-17T22:08:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-17T22:08:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2023-07-17T22:08:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2023-07-17T22:08:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-17T22:08:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04"
2023-07-17T22:08:36.843 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-17T22:08:36.844 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-17T22:08:36.844 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-17T22:08:36.844 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-17T22:08:36.844 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal
2023-07-17T22:08:36.844 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal
2023-07-17T22:08:36.845 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2023-07-17T22:08:41.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:08:41.879 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:08:46.984 INFO:teuthology.dispatcher.supervisor:Running job 7342074
2023-07-17T22:08:46.984 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-17_18:51:04-rados-wip-yuri6-testing-2023-07-17-0838-reef-distro-default-smithi/7342074 --name yuriw-2023-07-17_18:51:04-rados-wip-yuri6-testing-2023-07-17-0838-reef-distro-default-smithi --description rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} -- /home/teuthworker/archive/yuriw-2023-07-17_18:51:04-rados-wip-yuri6-testing-2023-07-17-0838-reef-distro-default-smithi/7342074/orig.config.yaml
2023-07-17T22:08:46.987 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-17_18:51:04-rados-wip-yuri6-testing-2023-07-17-0838-reef-distro-default-smithi/7342074
2023-07-17T22:08:46.988 INFO:teuthology.dispatcher.supervisor:Job PID: 4418
2023-07-17T22:08:46.989 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-17T22:10:47.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:10:47.083 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:12:52.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:12:52.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:14:57.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:14:57.442 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:17:02.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:17:02.621 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:19:02.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:19:02.802 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:21:07.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:21:07.986 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:23:08.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:23:08.146 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:25:13.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:25:13.321 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:27:18.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:27:18.507 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:29:23.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:29:23.686 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:31:23.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:31:23.869 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:33:29.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:33:29.074 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:35:34.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T22:35:34.258 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T22:35:39.338 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-17T22:35:42.607 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-17T22:35:42.607 INFO:teuthology.nuke:Checking targets against current locks
2023-07-17T22:35:42.655 DEBUG:teuthology.nuke:shortname: smithi100
2023-07-17T22:35:42.656 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-17T22:35:42.687 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-17_18:51:04-rados-wip-yuri6-testing-2023-07-17-0838-reef-distro-default-smithi/7342074', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-17 22:02:02.672741', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-17T22:35:42.749 INFO:teuthology.orchestra.console:Power off smithi100
2023-07-17T22:35:42.750 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T22:35:42.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T22:35:42.904 INFO:teuthology.orchestra.console:Power off for smithi100 completed
2023-07-17T22:35:43.069 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com