2024-01-27T21:10:23.000 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-27T21:10:23.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:10:23.100 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4a30b7bf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4a31ae1c10>, signals=[15])
2024-01-27T21:10:23.101 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging
2024-01-27T21:10:23.101 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server
2024-01-27T21:10:23.101 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-01-27T21:10:23.212 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-27T21:10:23.253 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6
2024-01-27T21:10:23.479 INFO:teuthology.orchestra.console.smithi179:Power off
2024-01-27T21:10:23.479 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T21:10:23.499 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2024-01-27T21:10:23.500 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:10:23.524 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-27T21:10:27.528 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:10:27.637 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-27T21:10:31.638 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:10:31.747 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-27T21:10:35.751 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:10:35.860 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-27T21:10:35.960 INFO:teuthology.orchestra.console.smithi179:Power off completed
2024-01-27T21:10:36.061 INFO:teuthology.orchestra.console.smithi179:Power on
2024-01-27T21:10:36.061 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-27T21:10:36.084 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On
2024-01-27T21:10:36.084 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:10:36.105 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-27T21:10:40.110 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:10:40.218 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on
2024-01-27T21:10:40.319 INFO:teuthology.orchestra.console.smithi179:Power on completed
2024-01-27T21:10:40.419 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish
2024-01-27T21:13:26.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:13:44.764 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:13:50.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:13:53.820 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:13:59.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:14:02.876 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:14:08.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:14:11.932 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:14:17.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:14:20.988 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:14:26.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:14:30.044 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:14:36.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:14:39.100 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179
2024-01-27T21:14:45.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:15:45.151 WARNING:teuthology.provision.fog.smithi179:timed out
2024-01-27T21:15:51.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:15:51.436 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-27T21:15:51.436 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-27T21:15:51.664 INFO:teuthology.provision.fog.smithi179:Node is ready
2024-01-27T21:15:51.664 DEBUG:teuthology.orchestra.run.smithi179:> hostname
2024-01-27T21:15:51.683 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com
2024-01-27T21:15:51.684 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts
2024-01-27T21:15:51.739 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179
2024-01-27T21:15:51.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-01-27T21:15:51.854 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts
2024-01-27T21:15:51.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts
2024-01-27T21:15:51.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname
2024-01-27T21:15:52.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179
2024-01-27T21:15:52.080 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-01-27T21:15:52.134 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2024-01-27T21:15:52.134 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T21:15:52.135 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-27T21:15:52.136 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-27T21:15:52.136 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-27T21:15:52.136 INFO:teuthology.provision.fog.smithi179:Deploy complete!
2024-01-27T21:15:52.137 DEBUG:teuthology.parallel:result is None
2024-01-27T21:15:52.255 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com
2024-01-27T21:15:52.256 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-27T21:15:52.287 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server
2024-01-27T21:15:52.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-01-27T21:15:52.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-27T21:15:52.378 DEBUG:teuthology.orchestra.run.smithi179:> true
2024-01-27T21:15:52.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com'
2024-01-27T21:15:52.445 DEBUG:teuthology.orchestra.run.smithi179:> uname -m
2024-01-27T21:15:52.500 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64
2024-01-27T21:15:52.500 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release
2024-01-27T21:15:52.555 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux"
2024-01-27T21:15:52.555 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)"
2024-01-27T21:15:52.555 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel"
2024-01-27T21:15:52.555 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora"
2024-01-27T21:15:52.555 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-27T21:15:52.556 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-27T21:15:52.557 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server
2024-01-27T21:15:52.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:15:52.659 INFO:teuthology.dispatcher.supervisor:Running job 7534963
2024-01-27T21:15:52.659 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_15:13:40-orch-main-distro-default-smithi/7534963 --name yuriw-2024-01-26_15:13:40-orch-main-distro-default-smithi --description orch/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli} -- /home/teuthworker/archive/yuriw-2024-01-26_15:13:40-orch-main-distro-default-smithi/7534963/orig.config.yaml
2024-01-27T21:15:52.662 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_15:13:40-orch-main-distro-default-smithi/7534963
2024-01-27T21:15:52.662 INFO:teuthology.dispatcher.supervisor:Job PID: 2058829
2024-01-27T21:15:52.663 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-27T21:17:52.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:19:52.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:21:53.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:23:53.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:25:53.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:27:53.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:29:53.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:31:53.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:33:54.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:35:54.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:37:54.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:39:54.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:41:54.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:43:54.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-27T21:43:55.040 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-27T21:43:55.148 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-27T21:43:55.148 INFO:teuthology.nuke:Checking targets against current locks
2024-01-27T21:43:55.201 DEBUG:teuthology.nuke:shortname: smithi179
2024-01-27T21:43:55.202 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-27T21:43:55.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_15:13:40-orch-main-distro-default-smithi/7534963', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-27 21:10:22.041796', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvCSSEa2tbsZVN9B9rS8ZYBVbHwwrVNVay9Q6inqd3W5fbZTQwkaqLsqSzLuYaEn0XBG9y42ziDmf78YezhV54='}
2024-01-27T21:43:55.262 INFO:teuthology.orchestra.console.smithi179:Power off
2024-01-27T21:43:55.262 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-27T21:43:55.284 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off
2024-01-27T21:43:55.284 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-27T21:43:55.308 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off
2024-01-27T21:43:55.409 INFO:teuthology.orchestra.console.smithi179:Power off completed
2024-01-27T21:43:55.563 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com