2023-06-22T03:35:59.089 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-22T03:35:59.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T03:35:59.091 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T03:36:08.878 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff743e9e640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff7450bd8b0>, signals=[15])
2023-06-22T03:36:08.879 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-06-22T03:36:08.879 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-06-22T03:36:08.880 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-06-22T03:36:08.904 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"}
2023-06-22T03:36:08.973 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-22T03:36:09.012 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-22T03:36:09.012 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 5}
2023-06-22T03:36:09.053 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.6
2023-06-22T03:36:09.054 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-06-22T03:36:09.099 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"}
2023-06-22T03:36:09.129 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1}
2023-06-22T03:36:09.182 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-06-22T03:36:09.271 INFO:teuthology.orchestra.console:Power off smithi136
2023-06-22T03:36:09.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T03:36:09.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:13.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:18.435 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:23.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:28.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:33.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:33.984 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2023-06-22T03:36:34.085 INFO:teuthology.orchestra.console:Power on smithi136
2023-06-22T03:36:34.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-22T03:36:34.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:38.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:42.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:36:42.465 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2023-06-22T03:36:42.566 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-06-22T03:36:42.567 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-06-22T03:36:52.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:37:00.688 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-06-22T03:37:06.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:37:11.120 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-06-22T03:37:17.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:37:25.204 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-06-22T03:37:31.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:37:35.824 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-06-22T03:37:41.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:37:44.880 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-06-22T03:37:50.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:38:27.928 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-22T03:38:27.929 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-22T03:38:28.276 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-06-22T03:38:28.276 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2023-06-22T03:38:28.291 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2023-06-22T03:38:28.292 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2023-06-22T03:38:28.348 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2023-06-22T03:38:28.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-06-22T03:38:28.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2023-06-22T03:38:28.501 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2023-06-22T03:38:28.570 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2023-06-22T03:38:28.638 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-06-22T03:38:28.703 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-06-22T03:38:28.759 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2023-06-22T03:38:28.760 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)"
2023-06-22T03:38:28.760 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2023-06-22T03:38:28.760 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2023-06-22T03:38:28.760 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6"
2023-06-22T03:38:28.760 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T03:38:28.761 INFO:teuthology.orchestra.run.smithi136.stdout:
2023-06-22T03:38:28.762 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-22T03:38:28.762 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-22T03:38:28.762 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-22T03:38:28.762 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-22T03:38:28.763 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-06-22T03:38:28.764 DEBUG:teuthology.parallel:result is None
2023-06-22T03:38:43.900 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2023-06-22T03:38:43.901 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-22T03:38:48.943 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2023-06-22T03:38:48.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-06-22T03:38:48.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T03:38:54.021 DEBUG:teuthology.orchestra.run.smithi136:> true
2023-06-22T03:38:54.155 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2023-06-22T03:38:54.213 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2023-06-22T03:38:54.214 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-06-22T03:38:54.270 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2023-06-22T03:38:54.270 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-06-22T03:38:54.271 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-22T03:38:54.272 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-22T03:38:54.273 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-22T03:38:54.274 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-06-22T03:38:59.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T03:38:59.274 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T03:39:00.861 INFO:teuthology.dispatcher.supervisor:Running job 7310867
2023-06-22T03:39:00.861 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-06-21_22:15:54-rados-wip-rishabh-improvements-authmon-distro-default-smithi/7310867 --name rishabh-2023-06-21_22:15:54-rados-wip-rishabh-improvements-authmon-distro-default-smithi --description rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} -- /home/teuthworker/archive/rishabh-2023-06-21_22:15:54-rados-wip-rishabh-improvements-authmon-distro-default-smithi/7310867/orig.config.yaml
2023-06-22T03:39:00.867 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-06-21_22:15:54-rados-wip-rishabh-improvements-authmon-distro-default-smithi/7310867
2023-06-22T03:39:00.868 INFO:teuthology.dispatcher.supervisor:Job PID: 27382
2023-06-22T03:39:00.868 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-22T03:41:00.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T03:41:00.969 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T03:43:06.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T03:43:06.150 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T03:45:11.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T03:45:11.333 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T03:47:13.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T03:47:13.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T03:47:18.456 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-22T03:47:23.513 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-22T03:47:23.514 INFO:teuthology.nuke:Checking targets against current locks
2023-06-22T03:47:30.674 DEBUG:teuthology.nuke:shortname: smithi136
2023-06-22T03:47:30.675 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-22T03:47:35.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-21_22:15:54-rados-wip-rishabh-improvements-authmon-distro-default-smithi/7310867', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 03:35:58.281770', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-22T03:47:40.777 INFO:teuthology.orchestra.console:Power off smithi136
2023-06-22T03:47:40.778 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T03:47:40.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T03:47:40.923 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2023-06-22T03:47:41.076 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com