2023-12-15T18:21:01.606 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-15T18:21:01.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:21:01.704 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f60b30fe520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f60b4046940>, signals=[15])
2023-12-15T18:21:01.704 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging
2023-12-15T18:21:01.704 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server
2023-12-15T18:21:01.704 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2023-12-15T18:21:01.833 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_9.stream (ID 10)
2023-12-15T18:21:01.873 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 9.stream
2023-12-15T18:21:02.127 INFO:teuthology.orchestra.console.smithi078:Power off
2023-12-15T18:21:02.127 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:21:02.147 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2023-12-15T18:21:02.148 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:21:02.168 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-12-15T18:21:02.269 INFO:teuthology.orchestra.console.smithi078:Power off completed
2023-12-15T18:21:02.370 INFO:teuthology.orchestra.console.smithi078:Power on
2023-12-15T18:21:02.370 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-15T18:21:02.393 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On
2023-12-15T18:21:02.393 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:21:02.415 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-12-15T18:21:06.417 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:21:06.526 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-12-15T18:21:10.529 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:21:10.637 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on
2023-12-15T18:21:10.738 INFO:teuthology.orchestra.console.smithi078:Power on completed
2023-12-15T18:21:10.839 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2023-12-15T18:23:41.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:24:00.278 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-12-15T18:24:06.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:24:09.365 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-12-15T18:24:15.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:24:18.449 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-12-15T18:24:24.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:24:27.537 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-12-15T18:24:33.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:24:36.593 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78
2023-12-15T18:24:42.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:25:42.658 WARNING:teuthology.provision.fog.smithi078:timed out
2023-12-15T18:25:48.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:25:48.873 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-15T18:25:48.874 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-15T18:25:49.198 INFO:teuthology.provision.fog.smithi078:Node is ready
2023-12-15T18:25:49.198 DEBUG:teuthology.orchestra.run.smithi078:> hostname
2023-12-15T18:25:49.213 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2023-12-15T18:25:49.214 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts
2023-12-15T18:25:49.268 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2023-12-15T18:25:49.268 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2023-12-15T18:25:49.376 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts
2023-12-15T18:25:49.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts
2023-12-15T18:25:49.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname
2023-12-15T18:25:49.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078
2023-12-15T18:25:49.608 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2023-12-15T18:25:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2023-12-15T18:25:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9"
2023-12-15T18:25:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2023-12-15T18:25:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2023-12-15T18:25:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9"
2023-12-15T18:25:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9"
2023-12-15T18:25:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-15T18:25:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2023-12-15T18:25:49.664 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon"
2023-12-15T18:25:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-15T18:25:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2023-12-15T18:25:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:25:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-15T18:25:49.665 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-15T18:25:49.666 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2023-12-15T18:25:49.667 DEBUG:teuthology.parallel:result is None
2023-12-15T18:25:49.795 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2023-12-15T18:25:49.795 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-15T18:25:49.820 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2023-12-15T18:25:49.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com'
2023-12-15T18:25:49.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-15T18:25:49.902 DEBUG:teuthology.orchestra.run.smithi078:> true
2023-12-15T18:25:49.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com'
2023-12-15T18:25:49.967 DEBUG:teuthology.orchestra.run.smithi078:> uname -m
2023-12-15T18:25:50.022 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2023-12-15T18:25:50.023 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release
2023-12-15T18:25:50.076 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-12-15T18:25:50.077 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/"
2023-12-15T18:25:50.078 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-15T18:25:50.078 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-12-15T18:25:50.078 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-15T18:25:50.078 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2023-12-15T18:25:50.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:25:50.183 INFO:teuthology.dispatcher.supervisor:Running job 7493236
2023-12-15T18:25:50.183 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493236 --name cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi --description rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} -- /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493236/orig.config.yaml
2023-12-15T18:25:50.186 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493236
2023-12-15T18:25:50.186 INFO:teuthology.dispatcher.supervisor:Job PID: 3071944
2023-12-15T18:25:50.187 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-15T18:27:50.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:29:50.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:31:50.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:33:50.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:35:50.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:37:51.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:39:51.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:41:51.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:43:51.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:45:51.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:47:51.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:49:52.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-15T18:49:52.224 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-15T18:49:52.285 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-15T18:49:52.285 INFO:teuthology.nuke:Checking targets against current locks
2023-12-15T18:49:52.329 DEBUG:teuthology.nuke:shortname: smithi078
2023-12-15T18:49:52.330 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-15T18:49:52.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-12-15_15:26:38-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7493236', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-15 18:21:00.815457', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHUMRUdsqkq71IdOfQf64kROKbZajP2OLb5pG75sqKdVGiXlgcGP7arQnOr5v0D+if/XGG9fytUwljH751O0XLE='}
2023-12-15T18:49:52.401 INFO:teuthology.orchestra.console.smithi078:Power off
2023-12-15T18:49:52.402 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-15T18:49:52.423 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off
2023-12-15T18:49:52.424 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-15T18:49:52.446 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off
2023-12-15T18:49:52.547 INFO:teuthology.orchestra.console.smithi078:Power off completed
2023-12-15T18:49:52.697 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com