2024-03-17T08:40:01.067 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-17T08:40:01.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:40:01.185 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc80360c10>, signals=[15]) 2024-03-17T08:40:01.186 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2024-03-17T08:40:01.186 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T08:40:01.186 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-17T08:40:01.328 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2024-03-17T08:40:01.380 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2024-03-17T08:40:01.601 INFO:teuthology.orchestra.console.smithi172:Power off 2024-03-17T08:40:01.601 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T08:40:01.623 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-03-17T08:40:01.623 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:01.644 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-17T08:40:05.648 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:05.757 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-17T08:40:09.758 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:09.867 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-17T08:40:13.871 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:13.980 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-17T08:40:14.081 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-03-17T08:40:14.181 INFO:teuthology.orchestra.console.smithi172:Power on 2024-03-17T08:40:14.182 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T08:40:14.204 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-03-17T08:40:14.204 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:14.225 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-17T08:40:18.226 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:18.339 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-03-17T08:40:22.342 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T08:40:22.451 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-03-17T08:40:22.552 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-03-17T08:40:22.652 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2024-03-17T08:43:08.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:43:26.879 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-17T08:43:32.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:43:35.938 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-17T08:43:41.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:43:45.022 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-17T08:43:51.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:43:54.078 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-17T08:44:00.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:44:03.166 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-03-17T08:44:09.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:45:09.227 WARNING:teuthology.provision.fog.smithi172:timed out 2024-03-17T08:45:15.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:45:15.495 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T08:45:15.495 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T08:45:15.808 INFO:teuthology.provision.fog.smithi172:Node is ready 2024-03-17T08:45:15.808 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2024-03-17T08:45:15.823 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2024-03-17T08:45:15.823 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2024-03-17T08:45:15.877 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2024-03-17T08:45:15.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-03-17T08:45:15.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2024-03-17T08:45:16.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2024-03-17T08:45:16.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2024-03-17T08:45:16.150 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-03-17T08:45:16.217 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-17T08:45:16.273 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-03-17T08:45:16.274 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-03-17T08:45:16.274 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-03-17T08:45:16.274 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-03-17T08:45:16.274 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T08:45:16.275 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T08:45:16.276 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2024-03-17T08:45:16.277 DEBUG:teuthology.parallel:result is None 2024-03-17T08:45:16.409 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2024-03-17T08:45:16.409 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T08:45:16.432 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2024-03-17T08:45:16.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-17T08:45:16.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T08:45:16.523 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-03-17T08:45:16.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-03-17T08:45:16.588 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-03-17T08:45:16.642 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-03-17T08:45:16.643 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-03-17T08:45:16.696 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T08:45:16.697 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T08:45:16.698 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T08:45:16.698 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-03-17T08:45:16.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:45:16.816 INFO:teuthology.dispatcher.supervisor:Running job 7599286 2024-03-17T08:45:16.816 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599286 --name teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi --description fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} -- /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599286/orig.config.yaml 2024-03-17T08:45:16.819 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-13_21:24:03-fs-squid-distro-default-smithi/7599286 2024-03-17T08:45:16.819 INFO:teuthology.dispatcher.supervisor:Job PID: 2113472 2024-03-17T08:45:16.819 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-17T08:47:16.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:49:17.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:51:17.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:53:17.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:55:17.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:57:17.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T08:59:17.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:01:17.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:03:18.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:05:18.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:07:18.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:09:18.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:11:18.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:13:19.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:15:19.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:17:19.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:19:19.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:21:19.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:23:19.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:25:20.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:27:20.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:29:20.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:31:20.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:33:20.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:35:20.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:37:21.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:39:21.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:41:21.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:43:21.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:45:21.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:47:21.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:49:21.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:51:22.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:53:22.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:55:22.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:57:22.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T09:59:22.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:01:22.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:03:23.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:05:23.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:07:23.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:09:23.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:11:23.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:13:23.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:15:23.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:17:24.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:19:24.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:21:24.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:23:24.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:25:24.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:27:24.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:29:25.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:31:25.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:33:25.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:35:25.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:37:25.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:39:25.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:41:26.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:43:26.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:45:26.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:47:26.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:49:26.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:51:26.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T10:51:27.015 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1