2023-07-22T11:44:48.230 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-22T11:44:48.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:44:48.232 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:44:48.369 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fab9fa7a820>, signals=[15]) 2023-07-22T11:44:48.370 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-07-22T11:44:48.371 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-07-22T11:44:48.371 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-07-22T11:44:48.400 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-07-22T11:44:48.475 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-22T11:44:48.520 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_8.stream (ID 3) 2023-07-22T11:44:48.521 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 3} 2023-07-22T11:44:48.569 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.stream 2023-07-22T11:44:48.570 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:44:48.634 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-07-22T11:44:48.672 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-07-22T11:44:48.720 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:44:48.814 INFO:teuthology.orchestra.console:Power off smithi160 2023-07-22T11:44:48.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T11:44:48.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:44:52.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:44:56.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:44:57.195 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2023-07-22T11:44:57.296 INFO:teuthology.orchestra.console:Power on smithi160 2023-07-22T11:44:57.297 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-22T11:44:57.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:45:01.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:45:05.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T11:45:05.667 INFO:teuthology.orchestra.console:Power on for smithi160 completed 2023-07-22T11:45:05.768 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-07-22T11:45:05.769 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:45:20.840 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:45:35.916 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:45:50.996 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:46:06.068 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:46:21.143 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:46:36.212 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:46:51.299 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:47:06.380 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:47:21.464 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:47:36.536 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:47:51.612 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-07-22T11:47:51.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:48:10.224 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:48:16.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:48:19.280 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:48:25.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:48:28.340 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:48:34.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:48:37.428 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:48:43.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:48:46.512 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:48:52.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:48:55.568 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:49:01.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:49:11.924 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:49:17.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:49:21.008 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:49:27.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:49:30.064 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-07-22T11:49:36.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:49:36.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-22T11:49:36.320 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-22T11:49:56.496 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-07-22T11:49:56.497 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-07-22T11:49:56.519 INFO:teuthology.orchestra.run.smithi160.stdout:smithi193 2023-07-22T11:49:56.520 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi193 /etc/hosts 2023-07-22T11:49:56.579 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2023-07-22T11:49:56.579 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-07-22T11:49:56.718 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi193/smithi160/g' /etc/hosts 2023-07-22T11:49:56.747 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.193/172.21.15.160/g' /etc/hosts 2023-07-22T11:49:56.816 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi193/smithi160/g' /etc/hostname 2023-07-22T11:49:56.884 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-07-22T11:49:56.951 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-07-22T11:49:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2023-07-22T11:49:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8" 2023-07-22T11:49:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2023-07-22T11:49:57.009 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2023-07-22T11:49:57.010 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T11:49:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T11:49:57.011 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T11:49:57.011 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-07-22T11:49:57.012 DEBUG:teuthology.parallel:result is None 2023-07-22T11:49:57.137 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-07-22T11:49:57.138 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-22T11:49:57.164 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-07-22T11:49:57.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-07-22T11:49:57.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T11:49:57.233 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-07-22T11:49:57.307 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-07-22T11:49:57.308 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-07-22T11:49:57.366 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-07-22T11:49:57.367 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-07-22T11:49:57.424 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2023-07-22T11:49:57.425 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8" 2023-07-22T11:49:57.425 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2023-07-22T11:49:57.425 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2023-07-22T11:49:57.425 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2023-07-22T11:49:57.426 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-07-22T11:49:57.426 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-22T11:49:57.426 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-07-22T11:49:57.427 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-22T11:49:57.427 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2023-07-22T11:49:57.427 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T11:49:57.428 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T11:49:57.428 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-22T11:49:57.430 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-07-22T11:49:57.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:49:57.463 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:49:57.552 INFO:teuthology.dispatcher.supervisor:Running job 7347559 2023-07-22T11:49:57.553 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347559 --name yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi --description rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} -- /home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347559/orig.config.yaml 2023-07-22T11:49:57.556 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347559 2023-07-22T11:49:57.557 INFO:teuthology.dispatcher.supervisor:Job PID: 23382 2023-07-22T11:49:57.558 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-22T11:51:57.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:51:57.610 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:53:57.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:53:57.781 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:55:57.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:55:57.957 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:57:58.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:57:58.142 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T11:59:58.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T11:59:58.317 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:01:58.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:01:58.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:03:58.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:03:58.666 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:05:58.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T12:05:58.846 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-22T12:05:58.926 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-22T12:05:59.000 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-22T12:05:59.001 INFO:teuthology.nuke:Checking targets against current locks 2023-07-22T12:05:59.052 DEBUG:teuthology.nuke:shortname: smithi160 2023-07-22T12:05:59.053 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T12:05:59.081 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_18:10:23-rados-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7347559', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 11:44:47.451112', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFdOMwTmc3+t01yq7dkT15PRKzApEDggutNPo64SBKRVzt6kH5nS8MUsAYvluampVYF9nmj0uTmvinXqrPcwCfeGpI91Akt9FyB5baJSwl4ArweXp9+KDortudEVQtN+SwfSpZk9W+2TY242cDOKe6sCWs4ALZCz9jr/iP5Si9QGxB0d4mLuuuUSUfAA+kWC7pOWkKce2kyKVMO8QPFKPZI/eAc6DUEjxfaUtbP/6oOrSCp371sfjJMgNtsQc3SQfTeXQb91v+PP5xrQSw34rPRfF4Gn67C0PlErMdUgR3kE9OweVbYoHxsKHSlu8h2fuTYn2wYjvI/IbL+2XY1dXaDUPnFU8x39baUB/BYUT9HFBHqQ9z8F64PsmpfHmHXkLdhgeLBAPHAttVyDTXtL78lcprSI1EkNWjDZT5tLomk9afBMGF4U0PrFoUQMj9Va2iZkjQmQaF42IhpCQe+6b+M0MvO4pF/4cIFZYdAsFnzMhKBJ7djsRGEbncN1rVvw8='} 2023-07-22T12:05:59.139 INFO:teuthology.orchestra.console:Power off smithi160 2023-07-22T12:05:59.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-22T12:05:59.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-22T12:05:59.285 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2023-07-22T12:05:59.440 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com