2023-12-01T21:13:48.677 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-01T21:13:48.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:13:48.777 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4a5c5c2460>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4a5d4de550>, signals=[15])
2023-12-01T21:13:48.777 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging
2023-12-01T21:13:48.778 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server
2023-12-01T21:13:48.778 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2023-12-01T21:13:48.906 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-01T21:13:48.950 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of rhel 8.4
2023-12-01T21:13:49.196 INFO:teuthology.orchestra.console.smithi162:Power off
2023-12-01T21:13:49.196 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-01T21:13:49.218 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2023-12-01T21:13:49.218 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:13:49.239 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2023-12-01T21:13:53.244 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:13:53.353 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2023-12-01T21:13:57.354 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:13:57.463 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2023-12-01T21:14:01.469 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:14:01.577 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-12-01T21:14:01.678 INFO:teuthology.orchestra.console.smithi162:Power off completed
2023-12-01T21:14:01.779 INFO:teuthology.orchestra.console.smithi162:Power on
2023-12-01T21:14:01.780 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-01T21:14:01.802 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On
2023-12-01T21:14:01.803 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:14:01.826 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-12-01T21:14:05.830 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:14:05.938 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2023-12-01T21:14:06.039 INFO:teuthology.orchestra.console.smithi162:Power on completed
2023-12-01T21:14:06.140 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2023-12-01T21:16:51.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:16:55.010 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:01.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:17:04.098 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:10.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:17:13.186 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:19.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:17:22.278 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:28.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:17:31.366 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:37.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:17:40.454 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:46.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:17:49.538 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2023-12-01T21:17:55.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:18:55.602 WARNING:teuthology.provision.fog.smithi162:timed out
2023-12-01T21:19:01.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:19:01.912 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-01T21:19:01.913 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-01T21:19:02.187 INFO:teuthology.provision.fog.smithi162:Node is ready
2023-12-01T21:19:02.187 DEBUG:teuthology.orchestra.run.smithi162:> hostname
2023-12-01T21:19:02.203 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162
2023-12-01T21:19:02.203 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162 /etc/hosts
2023-12-01T21:19:02.259 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162
2023-12-01T21:19:02.259 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2023-12-01T21:19:02.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162/smithi162/g' /etc/hosts
2023-12-01T21:19:02.394 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts
2023-12-01T21:19:02.460 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162/smithi162/g' /etc/hostname
2023-12-01T21:19:02.525 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162
2023-12-01T21:19:02.589 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2023-12-01T21:19:02.644 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux"
2023-12-01T21:19:02.645 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.4 (Ootpa)"
2023-12-01T21:19:02.645 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel"
2023-12-01T21:19:02.645 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora"
2023-12-01T21:19:02.645 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.4"
2023-12-01T21:19:02.646 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2023-12-01T21:19:02.646 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-01T21:19:02.646 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2023-12-01T21:19:02.646 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-01T21:19:02.647 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/"
2023-12-01T21:19:02.647 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-01T21:19:02.647 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-01T21:19:02.647 INFO:teuthology.orchestra.run.smithi162.stdout:
2023-12-01T21:19:02.648 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-01T21:19:02.648 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-01T21:19:02.648 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-01T21:19:02.648 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-01T21:19:02.649 INFO:teuthology.provision.fog.smithi162:Deploy complete!
2023-12-01T21:19:02.650 DEBUG:teuthology.parallel:result is None
2023-12-01T21:19:02.762 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com
2023-12-01T21:19:02.763 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-01T21:19:02.786 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server
2023-12-01T21:19:02.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com'
2023-12-01T21:19:02.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-01T21:19:02.854 DEBUG:teuthology.orchestra.run.smithi162:> true
2023-12-01T21:19:02.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com'
2023-12-01T21:19:02.916 DEBUG:teuthology.orchestra.run.smithi162:> uname -m
2023-12-01T21:19:02.969 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64
2023-12-01T21:19:02.969 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release
2023-12-01T21:19:03.023 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux"
2023-12-01T21:19:03.023 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.4 (Ootpa)"
2023-12-01T21:19:03.024 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel"
2023-12-01T21:19:03.024 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora"
2023-12-01T21:19:03.024 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.4"
2023-12-01T21:19:03.024 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8"
2023-12-01T21:19:03.025 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-01T21:19:03.025 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31"
2023-12-01T21:19:03.025 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-01T21:19:03.025 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/"
2023-12-01T21:19:03.026 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-01T21:19:03.026 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-01T21:19:03.026 INFO:teuthology.orchestra.run.smithi162.stdout:
2023-12-01T21:19:03.026 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-01T21:19:03.027 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-01T21:19:03.027 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-01T21:19:03.027 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-01T21:19:03.028 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2023-12-01T21:19:03.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:19:03.135 INFO:teuthology.dispatcher.supervisor:Running job 7474279
2023-12-01T21:19:03.135 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474279 --name yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi --description rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} -- /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474279/orig.config.yaml
2023-12-01T21:19:03.138 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474279
2023-12-01T21:19:03.138 INFO:teuthology.dispatcher.supervisor:Job PID: 2292161
2023-12-01T21:19:03.139 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-01T21:21:03.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:23:03.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:25:03.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:27:03.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:29:03.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:31:04.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:33:04.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:35:04.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:37:04.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-01T21:37:04.647 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-01T21:37:04.707 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-01T21:37:04.707 INFO:teuthology.nuke:Checking targets against current locks
2023-12-01T21:37:04.753 DEBUG:teuthology.nuke:shortname: smithi162
2023-12-01T21:37:04.753 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-01T21:37:04.778 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_16:53:58-rados-wip-yuri8-testing-2023-11-29-0706-pacific-distro-default-smithi/7474279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 21:13:47.913615', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKa5I+oJmClU0kTysav4tbVvRE0D3n07qNbsmgx0G9qRnnSh0HALODYbysxmb4d2TNqfM2pwa7McwuyopqQFBs='}
2023-12-01T21:37:04.830 INFO:teuthology.orchestra.console.smithi162:Power off
2023-12-01T21:37:04.831 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-01T21:37:04.852 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2023-12-01T21:37:04.852 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-01T21:37:04.872 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2023-12-01T21:37:04.973 INFO:teuthology.orchestra.console.smithi162:Power off completed
2023-12-01T21:37:05.120 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com