2024-03-19T11:56:44.725 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-19T11:56:44.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:56:44.846 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1427b42c10>, signals=[15]) 2024-03-19T11:56:44.846 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2024-03-19T11:56:44.846 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2024-03-19T11:56:44.846 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-03-19T11:56:44.993 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5) 2024-03-19T11:56:45.055 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6 2024-03-19T11:56:45.351 INFO:teuthology.orchestra.console.smithi057:Power off 2024-03-19T11:56:45.352 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T11:56:45.373 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-03-19T11:56:45.373 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:56:45.395 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-19T11:56:49.398 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:56:49.507 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-19T11:56:53.510 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:56:53.619 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-19T11:56:53.720 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-03-19T11:56:53.822 INFO:teuthology.orchestra.console.smithi057:Power on 2024-03-19T11:56:53.822 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-19T11:56:53.851 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2024-03-19T11:56:53.851 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:56:53.875 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-19T11:56:57.876 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:56:57.985 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-19T11:57:01.986 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:57:02.095 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-19T11:57:02.196 INFO:teuthology.orchestra.console.smithi057:Power on completed 2024-03-19T11:57:02.297 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2024-03-19T11:59:48.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:59:51.486 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T11:59:57.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:00:00.574 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T12:00:06.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:00:09.630 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T12:00:15.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:00:18.718 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T12:00:24.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:00:27.774 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T12:00:33.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:00:36.862 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T12:00:42.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:00:45.918 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-19T12:00:51.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:01:51.985 WARNING:teuthology.provision.fog.smithi057:timed out 2024-03-19T12:01:57.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:01:58.248 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-19T12:01:58.249 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-19T12:01:58.494 INFO:teuthology.provision.fog.smithi057:Node is ready 2024-03-19T12:01:58.494 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2024-03-19T12:01:58.555 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2024-03-19T12:01:58.556 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2024-03-19T12:01:58.616 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2024-03-19T12:01:58.616 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-03-19T12:01:58.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2024-03-19T12:01:58.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2024-03-19T12:01:58.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2024-03-19T12:01:58.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-03-19T12:01:58.984 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-03-19T12:01:59.046 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-19T12:01:59.047 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-03-19T12:01:59.048 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-03-19T12:01:59.048 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-03-19T12:01:59.048 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2024-03-19T12:01:59.050 DEBUG:teuthology.parallel:result is None 2024-03-19T12:01:59.200 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2024-03-19T12:01:59.201 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-19T12:01:59.229 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2024-03-19T12:01:59.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-19T12:01:59.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T12:01:59.304 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-03-19T12:01:59.375 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-19T12:01:59.376 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-03-19T12:01:59.437 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-03-19T12:01:59.437 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-03-19T12:01:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux" 2024-03-19T12:01:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)" 2024-03-19T12:01:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel" 2024-03-19T12:01:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora" 2024-03-19T12:01:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6" 2024-03-19T12:01:59.498 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-19T12:01:59.499 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-03-19T12:01:59.500 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-03-19T12:01:59.500 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-03-19T12:01:59.501 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-03-19T12:01:59.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:01:59.615 INFO:teuthology.dispatcher.supervisor:Running job 7606494 2024-03-19T12:01:59.615 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606494 --name yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi --description rbd/cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} data-pool/ec features/journaling msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} workloads/rbd_support_module_recovery} -- /home/teuthworker/archive/yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606494/orig.config.yaml 2024-03-19T12:01:59.618 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606494 2024-03-19T12:01:59.618 INFO:teuthology.dispatcher.supervisor:Job PID: 2529839 2024-03-19T12:01:59.618 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-19T12:03:59.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:05:59.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:08:00.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:10:00.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:12:00.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:14:00.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:16:00.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:18:00.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:20:01.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:22:01.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:22:01.350 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1