2024-02-29T20:20:50.528 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-29T20:20:50.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:20:50.630 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffbc10f6c10>, signals=[15]) 2024-02-29T20:20:50.631 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2024-02-29T20:20:50.631 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2024-02-29T20:20:50.631 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-02-29T20:20:50.783 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2024-02-29T20:20:50.834 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2024-02-29T20:20:51.132 INFO:teuthology.orchestra.console.smithi003:Power off 2024-02-29T20:20:51.133 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-29T20:20:51.156 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2024-02-29T20:20:51.157 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-29T20:20:51.179 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-29T20:20:55.181 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-29T20:20:55.290 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-29T20:20:59.292 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-29T20:20:59.401 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-29T20:21:03.404 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-29T20:21:03.512 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-02-29T20:21:03.613 INFO:teuthology.orchestra.console.smithi003:Power off completed 2024-02-29T20:21:03.714 INFO:teuthology.orchestra.console.smithi003:Power on 2024-02-29T20:21:03.714 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-29T20:21:03.737 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2024-02-29T20:21:03.737 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-29T20:21:03.759 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-02-29T20:21:07.762 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-29T20:21:07.871 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-02-29T20:21:07.972 INFO:teuthology.orchestra.console.smithi003:Power on completed 2024-02-29T20:21:08.072 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2024-02-29T20:23:39.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:23:42.208 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-29T20:23:48.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:23:51.292 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-29T20:23:57.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:24:00.352 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-29T20:24:06.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:24:09.436 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-29T20:24:15.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:24:18.524 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-29T20:24:24.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:24:27.584 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-02-29T20:24:33.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:25:33.653 WARNING:teuthology.provision.fog.smithi003:timed out 2024-02-29T20:25:39.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:25:39.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-29T20:25:39.952 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-29T20:25:40.285 INFO:teuthology.provision.fog.smithi003:Node is ready 2024-02-29T20:25:40.285 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2024-02-29T20:25:40.300 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2024-02-29T20:25:40.300 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2024-02-29T20:25:40.356 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2024-02-29T20:25:40.356 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-02-29T20:25:40.457 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2024-02-29T20:25:40.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2024-02-29T20:25:40.561 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2024-02-29T20:25:40.632 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-02-29T20:25:40.702 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-29T20:25:40.757 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-02-29T20:25:40.758 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-02-29T20:25:40.758 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-29T20:25:40.758 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-02-29T20:25:40.758 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-29T20:25:40.758 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-29T20:25:40.758 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-29T20:25:40.759 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2024-02-29T20:25:40.760 DEBUG:teuthology.parallel:result is None 2024-02-29T20:25:40.887 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2024-02-29T20:25:40.888 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-29T20:25:40.912 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2024-02-29T20:25:40.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-02-29T20:25:40.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-29T20:25:41.024 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-02-29T20:25:41.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-02-29T20:25:41.091 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-02-29T20:25:41.146 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-02-29T20:25:41.146 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-29T20:25:41.201 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-02-29T20:25:41.202 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-29T20:25:41.202 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-29T20:25:41.202 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-29T20:25:41.202 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-02-29T20:25:41.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:25:41.311 INFO:teuthology.dispatcher.supervisor:Running job 7577261 2024-02-29T20:25:41.311 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_kkeithle@teuthology --archive /home/teuthworker/archive/kkeithle-2024-02-29_19:15:50-rgw-wip-kkeithley-zipper-co-distro-default-smithi/7577261 --name kkeithle-2024-02-29_19:15:50-rgw-wip-kkeithley-zipper-co-distro-default-smithi --description rgw/lifecycle/{cluster ignore-pg-availability overrides s3tests-branch supported-random-distro$/{centos_latest} tasks/rgw_s3tests} -- /home/teuthworker/archive/kkeithle-2024-02-29_19:15:50-rgw-wip-kkeithley-zipper-co-distro-default-smithi/7577261/orig.config.yaml 2024-02-29T20:25:41.315 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kkeithle-2024-02-29_19:15:50-rgw-wip-kkeithley-zipper-co-distro-default-smithi/7577261 2024-02-29T20:25:41.315 INFO:teuthology.dispatcher.supervisor:Job PID: 4003786 2024-02-29T20:25:41.315 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-29T20:27:41.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:29:41.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:31:41.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:33:41.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:35:42.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:37:42.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:39:42.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:41:42.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:43:42.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:45:42.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:47:43.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:49:43.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:51:43.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:53:43.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:55:43.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:57:43.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T20:59:44.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:01:44.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:03:44.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:05:44.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:07:44.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:09:44.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:11:45.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:13:45.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:15:45.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:17:45.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:19:45.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:21:46.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:23:46.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:25:46.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:27:46.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:29:46.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:31:46.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:33:47.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-29T21:33:47.249 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1