2024-03-11T02:12:22.139 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-11T02:12:22.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:12:22.251 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa6e9d95f10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa6eae09c10>, signals=[15])
2024-03-11T02:12:22.251 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2024-03-11T02:12:22.251 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T02:12:22.252 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-11T02:12:22.389 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10)
2024-03-11T02:12:22.444 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream
2024-03-11T02:12:22.703 INFO:teuthology.orchestra.console.smithi090:Power off
2024-03-11T02:12:22.703 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T02:12:22.726 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off
2024-03-11T02:12:22.726 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:22.748 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-11T02:12:26.750 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:26.859 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-11T02:12:30.862 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:30.974 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-11T02:12:34.978 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:35.087 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-11T02:12:35.188 INFO:teuthology.orchestra.console.smithi090:Power off completed
2024-03-11T02:12:35.288 INFO:teuthology.orchestra.console.smithi090:Power on
2024-03-11T02:12:35.289 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T02:12:35.311 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On
2024-03-11T02:12:35.311 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:35.337 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-11T02:12:39.341 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:39.451 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-03-11T02:12:43.454 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T02:12:43.563 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-03-11T02:12:43.664 INFO:teuthology.orchestra.console.smithi090:Power on completed
2024-03-11T02:12:43.765 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2024-03-11T02:15:45.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:15:48.159 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:15:54.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:15:57.246 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:03.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:16:06.309 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:12.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:16:15.390 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:21.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:16:24.446 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:30.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:16:33.502 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:39.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:16:42.562 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:48.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:16:51.650 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-03-11T02:16:57.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:17:57.715 WARNING:teuthology.provision.fog.smithi090:timed out
2024-03-11T02:18:03.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:18:03.996 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T02:18:03.997 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T02:18:04.349 INFO:teuthology.provision.fog.smithi090:Node is ready
2024-03-11T02:18:04.350 DEBUG:teuthology.orchestra.run.smithi090:> hostname
2024-03-11T02:18:04.364 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2024-03-11T02:18:04.365 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts
2024-03-11T02:18:04.420 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2024-03-11T02:18:04.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-11T02:18:04.542 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts
2024-03-11T02:18:04.571 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts
2024-03-11T02:18:04.638 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname
2024-03-11T02:18:04.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-03-11T02:18:04.772 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T02:18:04.828 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-11T02:18:04.829 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2024-03-11T02:18:04.829 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T02:18:04.829 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-11T02:18:04.829 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T02:18:04.829 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T02:18:04.829 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T02:18:04.829 INFO:teuthology.provision.fog.smithi090:Deploy complete!
2024-03-11T02:18:04.831 DEBUG:teuthology.parallel:result is None
2024-03-11T02:18:04.965 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com
2024-03-11T02:18:04.965 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T02:18:04.992 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server
2024-03-11T02:18:04.992 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-11T02:18:04.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T02:18:05.079 DEBUG:teuthology.orchestra.run.smithi090:> true
2024-03-11T02:18:05.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com'
2024-03-11T02:18:05.144 DEBUG:teuthology.orchestra.run.smithi090:> uname -m
2024-03-11T02:18:05.198 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64
2024-03-11T02:18:05.199 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-03-11T02:18:05.252 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-03-11T02:18:05.253 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T02:18:05.254 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-11T02:18:05.254 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-11T02:18:05.254 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-03-11T02:18:05.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:18:05.368 INFO:teuthology.dispatcher.supervisor:Running job 7590286
2024-03-11T02:18:05.368 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-03-11_01:40:49-fs-main-testing-default-smithi/7590286 --name vshankar-2024-03-11_01:40:49-fs-main-testing-default-smithi --description fs/valgrind/{begin/{0-install 1-ceph 2-logrotate} centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/ignorelist_health tasks/mirror}} -- /home/teuthworker/archive/vshankar-2024-03-11_01:40:49-fs-main-testing-default-smithi/7590286/orig.config.yaml
2024-03-11T02:18:05.371 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-03-11_01:40:49-fs-main-testing-default-smithi/7590286
2024-03-11T02:18:05.371 INFO:teuthology.dispatcher.supervisor:Job PID: 3274641
2024-03-11T02:18:05.372 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-11T02:20:05.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:22:05.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:24:05.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:26:05.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:28:06.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:30:06.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:32:06.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:34:06.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:36:06.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:38:07.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:40:07.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:42:07.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:44:07.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:46:07.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:48:07.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:50:08.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:52:08.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:54:08.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:56:08.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T02:58:08.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:00:08.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:02:09.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:04:09.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:06:09.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:08:09.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:10:09.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:12:09.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:14:10.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:16:10.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:18:10.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:20:10.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:22:10.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:24:10.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:26:11.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:28:11.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:30:11.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:32:11.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:34:11.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:36:11.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:38:12.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:40:12.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:42:12.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:44:12.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:46:12.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:48:12.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:50:13.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:52:13.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:54:13.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T03:54:13.475 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1