2023-12-01T17:18:06.772 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T17:18:06.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:18:06.879 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2b61de4550>, signals=[15]) 2023-12-01T17:18:06.880 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-12-01T17:18:06.880 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-12-01T17:18:06.880 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-01T17:18:07.017 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2023-12-01T17:18:07.064 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2023-12-01T17:18:07.315 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-01T17:18:07.315 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T17:18:07.336 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-01T17:18:07.336 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:18:07.357 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-01T17:18:07.457 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-01T17:18:07.558 INFO:teuthology.orchestra.console.smithi187:Power on 2023-12-01T17:18:07.558 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-01T17:18:07.583 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-12-01T17:18:07.584 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:18:07.607 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-01T17:18:11.610 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:18:11.724 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-01T17:18:15.726 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:18:15.837 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-01T17:18:15.938 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-12-01T17:18:16.039 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-12-01T17:20:46.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:20:49.922 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:20:55.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:20:58.982 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:21:04.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:21:08.070 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:21:14.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:21:17.158 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:21:23.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:21:26.244 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:21:32.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:21:35.334 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:21:41.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:21:44.422 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-01T17:21:50.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:22:50.487 WARNING:teuthology.provision.fog.smithi187:timed out 2023-12-01T17:22:56.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:22:56.727 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-01T17:22:56.728 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-01T17:22:57.075 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-12-01T17:22:57.076 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-12-01T17:22:57.091 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-12-01T17:22:57.091 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-12-01T17:22:57.147 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-12-01T17:22:57.147 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-12-01T17:22:57.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-12-01T17:22:57.288 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-12-01T17:22:57.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-12-01T17:22:57.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-12-01T17:22:57.491 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-01T17:22:57.545 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-12-01T17:22:57.546 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:22:57.547 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-01T17:22:57.547 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T17:22:57.547 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-12-01T17:22:57.549 DEBUG:teuthology.parallel:result is None 2023-12-01T17:22:57.690 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-12-01T17:22:57.690 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-01T17:22:57.716 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-12-01T17:22:57.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-01T17:22:57.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T17:22:57.798 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-01T17:22:57.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-01T17:22:57.868 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-12-01T17:22:57.922 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-12-01T17:22:57.923 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-12-01T17:22:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-01T17:22:57.978 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-01T17:22:57.979 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-01T17:22:57.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:22:58.083 INFO:teuthology.dispatcher.supervisor:Running job 7473905 2023-12-01T17:22:58.083 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473905 --name yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi --description rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} -- /home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473905/orig.config.yaml 2023-12-01T17:22:58.087 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473905 2023-12-01T17:22:58.089 INFO:teuthology.dispatcher.supervisor:Job PID: 3418099 2023-12-01T17:22:58.089 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-01T17:24:58.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:26:58.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:28:58.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:30:58.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:32:58.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:34:59.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:36:59.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:38:59.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:40:59.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:42:59.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:44:59.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:47:00.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T17:47:00.214 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-01T17:47:00.275 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-01T17:47:00.275 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T17:47:00.319 DEBUG:teuthology.nuke:shortname: smithi187 2023-12-01T17:47:00.320 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T17:47:00.346 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-01_15:09:25-rados-wip-neorados-learning-from-experience-distro-default-smithi/7473905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 17:18:05.929688', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDRS5cRDL8w8ES+i6rXWo1ZBX7GDSMzSHSd4QFlfK5wXy7Z/w4MdSaLZ2NIUkPqPS3K6L4/cjeGnBHnEnUuFiiI='} 2023-12-01T17:47:00.399 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-01T17:47:00.400 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T17:47:00.422 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-01T17:47:00.422 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T17:47:00.449 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-01T17:47:00.549 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-01T17:47:00.705 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com