2023-07-21T06:08:36.178 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T06:08:36.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T06:08:36.179 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T06:08:36.298 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9841951e50>, signals=[15]) 2023-07-21T06:08:36.300 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-07-21T06:08:36.300 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T06:08:36.301 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-07-21T06:08:36.326 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"} 2023-07-21T06:08:51.411 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-21T06:08:56.456 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-21T06:08:56.457 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 6} 2023-07-21T06:09:01.511 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of ubuntu 22.04 2023-07-21T06:09:01.512 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-21T06:09:06.562 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T06:09:09.668 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1} 2023-07-21T06:09:09.738 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-21T06:09:11.095 INFO:teuthology.orchestra.console:Power off smithi115 2023-07-21T06:09:11.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T06:09:11.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:15.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:19.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:23.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:28.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:33.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:38.722 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:43.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:48.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:54.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:54.266 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-07-21T06:09:54.367 INFO:teuthology.orchestra.console:Power on smithi115 2023-07-21T06:09:54.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T06:09:54.386 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:09:58.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:10:03.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:10:08.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:10:08.841 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2023-07-21T06:10:08.942 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-07-21T06:10:08.943 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None 2023-07-21T06:10:08.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T06:10:12.052 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-21T06:10:18.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T06:10:21.136 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-21T06:10:27.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T06:10:40.208 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-21T06:10:46.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T06:10:54.292 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-21T06:11:00.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T06:11:08.368 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-07-21T06:11:14.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T06:11:51.130 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T06:11:51.131 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T06:11:51.410 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-07-21T06:11:51.411 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2023-07-21T06:11:51.429 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-07-21T06:11:51.432 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2023-07-21T06:11:51.491 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-07-21T06:11:51.491 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-07-21T06:11:51.613 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2023-07-21T06:11:51.641 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2023-07-21T06:11:51.713 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2023-07-21T06:11:51.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2023-07-21T06:11:51.857 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2023-07-21T06:11:51.918 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2023-07-21T06:11:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2023-07-21T06:11:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2023-07-21T06:11:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2023-07-21T06:11:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2023-07-21T06:11:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2023-07-21T06:11:51.919 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-21T06:11:51.920 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2023-07-21T06:11:51.920 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-21T06:11:51.920 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2023-07-21T06:11:51.920 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T06:11:51.920 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T06:11:51.920 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T06:11:51.922 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi115's OS to be ubuntu 22.04 but found centos 8 2023-07-21T06:11:51.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T06:11:51.923 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T06:11:57.017 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T06:12:03.763 DEBUG:teuthology.nuke:shortname: smithi115 2023-07-21T06:12:03.764 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T06:12:03.792 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:59-rbd-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7345901', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 06:08:35.329513', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaiMs2g4HtbpwdT9ZQuQf03ZLhQBCmEroFhsJVyiD7s1rZaQJnuJ2Vs/dEna5Q/7hvtrYRbHBDExIWgT8zkMSTCmF/yfCfYgR9FklJ0MhhE9u7HxKR4f41yT0tt8vTPfe/iovFRtc6Y5/5/sFvP50kkkdgy39YP0/ymCtB0GaWC/vLnJMsOFp14VIiU/NdtSO6PV7iJm/o9ZOuw55CFpOAVnhPlCxVk6PnOqrcqQ5EmZVbOGxqpctsRmLAdAPp2yFwGfApj97Qpf5p+xHA1agnaqH0GfCEFMNHKxeQQ802i2FnpyHl3mMxcjQvCY2TFDL/Q+bA5plkvdzH4nvU3jabnAJKbhaadE+bVULC+8ORIN8nMI7f3LQkoTBuK9zsyX+C7+ErbG4OJ4isFZUC7e9BN7nO1t+FJoZg9bCrZRM8WzuJH+dzGEY4Lbn7fHkPjjvtjA8KK9b1zanRwqvomcqLn7v5vmc5jvQ0tx/8K9pHBMghj61cfyXnqsHf9HcBpC8='} 2023-07-21T06:12:03.847 INFO:teuthology.orchestra.console:Power off smithi115 2023-07-21T06:12:03.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T06:12:03.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:07.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:13.011 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:18.127 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:23.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:28.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:33.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:38.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:43.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T06:12:43.907 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-07-21T06:12:54.071 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-07-21T06:12:59.204 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi115's OS to be ubuntu 22.04 but found centos 8