2024-02-16T13:10:24.935 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-16T13:10:24.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:10:25.048 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd26de02c10>, signals=[15]) 2024-02-16T13:10:25.049 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-02-16T13:10:25.049 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-02-16T13:10:25.049 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-02-16T13:10:25.187 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_9.stream (ID 10) 2024-02-16T13:10:25.229 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 9.stream 2024-02-16T13:10:25.535 INFO:teuthology.orchestra.console.smithi005:Power off 2024-02-16T13:10:25.535 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-16T13:10:25.558 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-02-16T13:10:25.558 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T13:10:25.583 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-02-16T13:10:25.684 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-02-16T13:10:25.784 INFO:teuthology.orchestra.console.smithi005:Power on 2024-02-16T13:10:25.785 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-16T13:10:25.810 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-02-16T13:10:25.810 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T13:10:25.836 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-02-16T13:10:29.840 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-16T13:10:29.949 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-02-16T13:10:30.049 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-02-16T13:10:30.150 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-02-16T13:13:01.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:13:04.604 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-16T13:13:10.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:13:13.664 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-16T13:13:19.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:13:22.752 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-16T13:13:28.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:13:31.836 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-16T13:13:37.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:13:40.896 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-16T13:13:46.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:14:46.919 WARNING:teuthology.provision.fog.smithi005:timed out 2024-02-16T13:14:52.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:14:53.197 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-16T13:14:53.198 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-16T13:14:53.537 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-02-16T13:14:53.537 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-02-16T13:14:53.555 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-02-16T13:14:53.555 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-02-16T13:14:53.608 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-02-16T13:14:53.608 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-02-16T13:14:53.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-02-16T13:14:53.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-02-16T13:14:53.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-02-16T13:14:53.910 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-02-16T13:14:53.981 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-02-16T13:14:54.036 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-02-16T13:14:54.036 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-02-16T13:14:54.036 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-02-16T13:14:54.036 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-02-16T13:14:54.036 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T13:14:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T13:14:54.038 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-02-16T13:14:54.039 DEBUG:teuthology.parallel:result is None 2024-02-16T13:14:54.163 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-02-16T13:14:54.163 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-16T13:14:54.186 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-02-16T13:14:54.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-16T13:14:54.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-16T13:14:54.287 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-02-16T13:14:54.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-16T13:14:54.354 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-02-16T13:14:54.409 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-02-16T13:14:54.410 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-02-16T13:14:54.464 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-02-16T13:14:54.464 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-02-16T13:14:54.464 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-02-16T13:14:54.464 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-02-16T13:14:54.464 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-02-16T13:14:54.464 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-16T13:14:54.465 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-16T13:14:54.466 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-02-16T13:14:54.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:14:54.606 INFO:teuthology.dispatcher.supervisor:Running job 7562338 2024-02-16T13:14:54.606 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-16_12:42:35-fs-wip-vshankar-testing-20240216.103400-testing-default-smithi/7562338 --name vshankar-2024-02-16_12:42:35-fs-wip-vshankar-testing-20240216.103400-testing-default-smithi --description fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} -- /home/teuthworker/archive/vshankar-2024-02-16_12:42:35-fs-wip-vshankar-testing-20240216.103400-testing-default-smithi/7562338/orig.config.yaml 2024-02-16T13:14:54.609 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-16_12:42:35-fs-wip-vshankar-testing-20240216.103400-testing-default-smithi/7562338 2024-02-16T13:14:54.609 INFO:teuthology.dispatcher.supervisor:Job PID: 4182222 2024-02-16T13:14:54.609 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-16T13:16:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:18:54.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:20:55.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:22:55.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:24:55.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:26:55.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:28:55.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:30:55.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:32:55.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:34:56.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:36:56.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:38:56.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:40:56.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:42:56.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:44:56.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:46:57.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:48:57.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:50:57.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:52:57.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:54:57.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:56:58.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T13:58:58.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:00:58.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:02:58.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:04:58.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:06:58.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:08:59.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:10:59.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:12:59.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:14:59.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:16:59.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:18:59.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:21:00.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:23:00.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:25:00.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:27:00.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:29:00.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:31:00.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:33:01.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:35:01.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:37:01.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:39:01.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:41:01.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:43:02.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:45:02.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:47:02.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:49:02.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:51:02.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-16T14:51:02.764 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1