2023-12-14T15:20:50.973 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T15:20:50.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:20:51.087 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8794222940>, signals=[15]) 2023-12-14T15:20:51.087 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-12-14T15:20:51.087 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T15:20:51.087 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-14T15:20:51.225 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T15:20:51.266 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.4 2023-12-14T15:20:51.870 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-14T15:20:51.870 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:20:51.892 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-14T15:20:51.893 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:20:51.913 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-14T15:20:52.014 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-14T15:20:52.115 INFO:teuthology.orchestra.console.smithi116:Power on 2023-12-14T15:20:52.115 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T15:20:52.135 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2023-12-14T15:20:52.135 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:20:52.154 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-14T15:20:56.157 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:20:56.266 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-14T15:21:00.269 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:21:00.378 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-14T15:21:00.478 INFO:teuthology.orchestra.console.smithi116:Power on completed 2023-12-14T15:21:00.579 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-12-14T15:26:21.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:26:24.754 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:26:30.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:26:33.809 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:26:39.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:26:42.865 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:26:48.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:26:51.953 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:26:57.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:27:01.042 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:27:07.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:27:25.458 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:27:31.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:27:34.546 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:27:40.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:27:43.634 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-12-14T15:27:49.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:27:50.071 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T15:27:50.072 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T15:28:10.331 INFO:teuthology.provision.fog.smithi116:Node is ready 2023-12-14T15:28:10.331 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2023-12-14T15:28:10.349 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2023-12-14T15:28:10.350 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2023-12-14T15:28:10.403 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2023-12-14T15:28:10.404 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-14T15:28:10.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2023-12-14T15:28:10.587 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2023-12-14T15:28:10.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2023-12-14T15:28:10.713 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2023-12-14T15:28:10.775 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-14T15:28:10.826 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.4" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:28:10.827 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:28:10.828 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-14T15:28:10.828 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:28:10.828 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:28:10.828 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:28:10.828 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:28:10.829 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2023-12-14T15:28:10.830 DEBUG:teuthology.parallel:result is None 2023-12-14T15:28:10.940 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2023-12-14T15:28:10.941 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T15:28:10.968 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2023-12-14T15:28:10.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-14T15:28:10.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:28:11.034 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-12-14T15:28:11.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-14T15:28:11.099 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-12-14T15:28:11.151 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-12-14T15:28:11.151 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-14T15:28:11.202 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.4" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:28:11.203 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:28:11.204 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:28:11.204 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-14T15:28:11.204 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:28:11.204 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:28:11.204 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:28:11.204 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:28:11.204 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-14T15:28:11.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:28:11.310 INFO:teuthology.dispatcher.supervisor:Running job 7491291 2023-12-14T15:28:11.310 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491291 --name yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi --description rbd/singleton/{all/rbd-vs-unmanaged-snaps conf/{disable-pool-app} objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} -- /home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491291/orig.config.yaml 2023-12-14T15:28:11.313 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491291 2023-12-14T15:28:11.313 INFO:teuthology.dispatcher.supervisor:Job PID: 3915605 2023-12-14T15:28:11.314 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T15:30:11.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:32:11.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:34:11.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:36:11.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:38:12.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:40:12.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:40:12.346 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T15:40:12.485 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T15:40:12.486 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T15:40:12.532 DEBUG:teuthology.nuke:shortname: smithi116 2023-12-14T15:40:12.532 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T15:40:12.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:19:03-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:20:50.227921', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKhcake1GNWCmpQ8FhcR5woE0zuGkSI8VFUY68w8lB1xSRTfCt0UheQhGMqEIWajubnfCMgdz6PJVRTCn+p6dk4='} 2023-12-14T15:40:12.619 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-14T15:40:12.619 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:40:12.665 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-14T15:40:12.666 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:40:12.703 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-14T15:40:12.805 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-14T15:40:12.955 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com