2023-12-22T19:45:53.325 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T19:45:53.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T19:45:53.427 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f774ba47940>, signals=[15]) 2023-12-22T19:45:53.427 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-12-22T19:45:53.428 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T19:45:53.428 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-12-22T19:45:53.567 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-22T19:45:53.616 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2023-12-22T19:45:53.843 INFO:teuthology.orchestra.console.smithi172:Power off 2023-12-22T19:45:53.843 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T19:45:53.867 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-12-22T19:45:53.867 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:45:53.887 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-22T19:45:57.891 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:45:58.000 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-22T19:46:02.004 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:46:02.113 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-22T19:46:06.117 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:46:06.226 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-22T19:46:06.326 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-12-22T19:46:06.427 INFO:teuthology.orchestra.console.smithi172:Power on 2023-12-22T19:46:06.427 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T19:46:06.446 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-12-22T19:46:06.447 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:46:06.467 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-22T19:46:10.471 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:46:10.578 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-22T19:46:14.579 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T19:46:14.690 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-22T19:46:14.791 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-12-22T19:46:14.891 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-12-22T19:50:49.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:51:07.794 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-22T19:51:13.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:51:16.882 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-22T19:51:22.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:51:25.969 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-22T19:51:31.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:51:35.058 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-22T19:51:41.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:51:44.114 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-22T19:51:50.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:51:53.201 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-22T19:51:59.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:52:59.266 WARNING:teuthology.provision.fog.smithi172:timed out 2023-12-22T19:53:05.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:53:05.504 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T19:53:05.504 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T19:53:05.799 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-12-22T19:53:05.799 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-12-22T19:53:05.816 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 2023-12-22T19:53:05.816 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172 /etc/hosts 2023-12-22T19:53:05.874 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-12-22T19:53:05.875 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-12-22T19:53:05.996 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hosts 2023-12-22T19:53:06.024 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-12-22T19:53:06.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hostname 2023-12-22T19:53:06.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-12-22T19:53:06.225 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T19:53:06.282 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T19:53:06.283 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T19:53:06.284 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-12-22T19:53:06.285 DEBUG:teuthology.parallel:result is None 2023-12-22T19:53:06.395 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-12-22T19:53:06.395 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T19:53:06.425 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-12-22T19:53:06.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-22T19:53:06.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T19:53:06.491 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-12-22T19:53:06.562 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-22T19:53:06.562 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-12-22T19:53:06.619 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-12-22T19:53:06.619 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-12-22T19:53:06.675 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T19:53:06.675 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2023-12-22T19:53:06.675 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2023-12-22T19:53:06.675 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T19:53:06.676 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-22T19:53:06.677 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-12-22T19:53:06.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T19:53:06.788 INFO:teuthology.dispatcher.supervisor:Running job 7499591 2023-12-22T19:53:06.788 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-22_19:44:54-rgw-wip-yuri2-testing-2023-12-21-0918-quincy-distro-default-smithi/7499591 --name yuriw-2023-12-22_19:44:54-rgw-wip-yuri2-testing-2023-12-21-0918-quincy-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{rhel_8}} -- /home/teuthworker/archive/yuriw-2023-12-22_19:44:54-rgw-wip-yuri2-testing-2023-12-21-0918-quincy-distro-default-smithi/7499591/orig.config.yaml 2023-12-22T19:53:06.791 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-22_19:44:54-rgw-wip-yuri2-testing-2023-12-21-0918-quincy-distro-default-smithi/7499591 2023-12-22T19:53:06.791 INFO:teuthology.dispatcher.supervisor:Job PID: 4100435 2023-12-22T19:53:06.791 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T19:55:06.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T19:57:07.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T19:59:07.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:01:07.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:03:07.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:05:07.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:07:07.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:09:08.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:11:08.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:13:08.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:15:08.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:17:08.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:19:08.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T20:19:09.024 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-22T20:19:09.109 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-22T20:19:09.109 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T20:19:09.151 DEBUG:teuthology.nuke:shortname: smithi172 2023-12-22T20:19:09.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T20:19:09.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-22_19:44:54-rgw-wip-yuri2-testing-2023-12-21-0918-quincy-distro-default-smithi/7499591', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 19:45:52.588901', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFd58v0I50QAjhKXgz0dBsI6mu9jUJZRqgmVAZafKB9PI9Rijyx8cx5rwedVSVtgU9Svig5Ljvjt5RLEbvuYnE8='} 2023-12-22T20:19:09.220 INFO:teuthology.orchestra.console.smithi172:Power off 2023-12-22T20:19:09.220 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T20:19:09.241 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-12-22T20:19:09.242 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T20:19:09.262 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-22T20:19:09.363 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-12-22T20:19:09.516 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com