2023-09-29T23:57:51.761 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-29T23:57:51.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-29T23:57:51.865 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d382bc670>, signals=[15]) 2023-09-29T23:57:51.865 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2023-09-29T23:57:51.865 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2023-09-29T23:57:51.866 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-09-29T23:57:51.892 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /host {"name": "smithi170"} 2023-09-29T23:57:51.964 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-09-29T23:57:52.003 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_rhel_8.4 (ID 7) 2023-09-29T23:57:52.004 DEBUG:teuthology.provision.fog.smithi170:FOG request: PUT /host/275 {"imageID": 7} 2023-09-29T23:57:52.052 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.4 2023-09-29T23:57:52.052 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:57:52.102 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /tasktype {"name": "deploy"} 2023-09-29T23:57:52.148 DEBUG:teuthology.provision.fog.smithi170:FOG request: POST /host/275/task {"taskTypeID": 1} 2023-09-29T23:57:52.207 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:57:52.289 INFO:teuthology.orchestra.console.smithi170:Power off 2023-09-29T23:57:52.290 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-29T23:57:52.309 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-09-29T23:57:52.309 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:57:52.332 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-09-29T23:57:52.432 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-09-29T23:57:52.533 INFO:teuthology.orchestra.console.smithi170:Power on 2023-09-29T23:57:52.533 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-29T23:57:52.555 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2023-09-29T23:57:52.555 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:57:52.575 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-09-29T23:57:56.578 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:57:56.687 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-09-29T23:58:00.690 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-29T23:58:00.797 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-09-29T23:58:00.898 INFO:teuthology.orchestra.console.smithi170:Power on completed 2023-09-29T23:58:00.999 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2023-09-29T23:58:00.999 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:58:16.073 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:58:31.139 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:58:46.205 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:59:01.270 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:59:16.338 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:59:31.406 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-29T23:59:46.474 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-30T00:00:01.541 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-30T00:00:16.610 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-30T00:00:31.678 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-30T00:00:46.754 DEBUG:teuthology.provision.fog.smithi170:FOG request: GET /task/active None 2023-09-30T00:00:46.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:01:05.150 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-09-30T00:01:11.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:01:14.234 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-09-30T00:01:20.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:01:23.290 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-09-30T00:01:29.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:01:32.350 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-09-30T00:01:38.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:02:38.415 WARNING:teuthology.provision.fog.smithi170:timed out 2023-09-30T00:02:44.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:02:44.761 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T00:02:44.761 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T00:02:45.050 INFO:teuthology.provision.fog.smithi170:Node is ready 2023-09-30T00:02:45.050 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2023-09-30T00:02:45.105 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2023-09-30T00:02:45.105 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi170.front.sepia.ceph.com /etc/hosts 2023-09-30T00:02:45.160 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2023-09-30T00:02:45.160 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-09-30T00:02:45.274 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hosts 2023-09-30T00:02:45.298 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.170/172.21.15.170/g' /etc/hosts 2023-09-30T00:02:45.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi170.front.sepia.ceph.com/smithi170/g' /etc/hostname 2023-09-30T00:02:45.426 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2023-09-30T00:02:45.489 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-09-30T00:02:45.543 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.4 (Ootpa)" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.4" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-30T00:02:45.544 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T00:02:45.545 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-30T00:02:45.546 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2023-09-30T00:02:45.547 DEBUG:teuthology.parallel:result is None 2023-09-30T00:02:45.693 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2023-09-30T00:02:45.694 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-30T00:02:45.717 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2023-09-30T00:02:45.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-09-30T00:02:45.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:02:45.781 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-09-30T00:02:45.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-09-30T00:02:45.800 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-09-30T00:02:45.854 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-09-30T00:02:45.854 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-09-30T00:02:45.908 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T00:02:45.908 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.4 (Ootpa)" 2023-09-30T00:02:45.908 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2023-09-30T00:02:45.908 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2023-09-30T00:02:45.908 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.4" 2023-09-30T00:02:45.909 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2023-09-30T00:02:45.909 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-30T00:02:45.909 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-09-30T00:02:45.909 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-30T00:02:45.909 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T00:02:45.910 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-30T00:02:45.911 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-09-30T00:02:45.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:02:46.017 INFO:teuthology.dispatcher.supervisor:Running job 7406692 2023-09-30T00:02:46.017 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406692 --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --description rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406692/orig.config.yaml 2023-09-30T00:02:46.020 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406692 2023-09-30T00:02:46.020 INFO:teuthology.dispatcher.supervisor:Job PID: 2621720 2023-09-30T00:02:46.021 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-30T00:04:46.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:06:46.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:08:46.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:10:46.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:12:46.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:14:46.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:16:47.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:18:47.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:20:47.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:22:47.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:24:47.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:24:47.863 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-30T00:24:47.923 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-30T00:24:47.924 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T00:24:47.971 DEBUG:teuthology.nuke:shortname: smithi170 2023-09-30T00:24:47.971 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T00:24:47.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 23:57:51.056812', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBXJyzB9+xeAT+LcR3cVOv906qiye76uv7+8G/poQnmMLNViQnqtl8dx5vVbL+gPEQpgazAuL7Ue2ex552OvNU='} 2023-09-30T00:24:48.035 INFO:teuthology.orchestra.console.smithi170:Power off 2023-09-30T00:24:48.036 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T00:24:48.060 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-09-30T00:24:48.060 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:24:48.082 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-09-30T00:24:48.182 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-09-30T00:24:48.329 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com