2023-10-06T12:37:42.530 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-06T12:37:42.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:37:42.671 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4ff9eb7ac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4ffa9ba670>, signals=[15])
2023-10-06T12:37:42.671 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging
2023-10-06T12:37:42.671 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server
2023-10-06T12:37:42.671 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-10-06T12:37:42.691 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"}
2023-10-06T12:37:42.765 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-06T12:37:42.814 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_centos_9.stream (ID 10)
2023-10-06T12:37:42.815 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 10}
2023-10-06T12:37:42.867 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 9.stream
2023-10-06T12:37:42.867 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:37:42.923 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"}
2023-10-06T12:37:42.964 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1}
2023-10-06T12:37:43.030 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:37:43.114 INFO:teuthology.orchestra.console.smithi158:Power off
2023-10-06T12:37:43.115 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T12:37:43.137 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off
2023-10-06T12:37:43.137 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:37:43.158 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-10-06T12:37:47.162 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:37:47.270 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-10-06T12:37:51.273 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:37:51.382 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-10-06T12:37:51.482 INFO:teuthology.orchestra.console.smithi158:Power off completed
2023-10-06T12:37:51.583 INFO:teuthology.orchestra.console.smithi158:Power on
2023-10-06T12:37:51.583 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-06T12:37:51.604 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On
2023-10-06T12:37:51.604 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:37:51.626 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-10-06T12:37:55.630 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:37:55.739 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-10-06T12:37:59.742 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T12:37:59.851 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on
2023-10-06T12:38:00.239 INFO:teuthology.orchestra.console.smithi158:Power on completed
2023-10-06T12:38:00.391 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish
2023-10-06T12:38:00.392 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:38:15.470 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:38:30.550 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:38:45.646 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:39:00.742 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:39:15.830 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:39:30.915 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:39:45.997 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:40:01.186 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:40:16.530 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:40:31.610 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:40:46.682 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:41:01.754 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None
2023-10-06T12:41:01.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:04.890 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:41:10.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:13.946 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:41:19.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:23.002 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:41:29.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:32.062 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:41:38.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:41.146 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:41:47.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:50.202 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:41:56.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:41:59.258 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158
2023-10-06T12:42:05.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:43:05.325 WARNING:teuthology.provision.fog.smithi158:timed out
2023-10-06T12:43:11.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:43:11.553 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-06T12:43:11.553 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-06T12:43:11.875 INFO:teuthology.provision.fog.smithi158:Node is ready
2023-10-06T12:43:11.962 DEBUG:teuthology.orchestra.run.smithi158:> hostname
2023-10-06T12:43:11.977 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com
2023-10-06T12:43:11.979 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts
2023-10-06T12:43:12.033 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158
2023-10-06T12:43:12.118 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-10-06T12:43:12.180 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts
2023-10-06T12:43:12.300 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts
2023-10-06T12:43:12.454 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname
2023-10-06T12:43:12.522 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158
2023-10-06T12:43:12.611 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-10-06T12:43:12.665 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream"
2023-10-06T12:43:12.738 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="9"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="9"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el9"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31"
2023-10-06T12:43:12.740 INFO:teuthology.orchestra.run.smithi158.stdout:LOGO="fedora-logo-icon"
2023-10-06T12:43:12.741 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-06T12:43:12.741 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/"
2023-10-06T12:43:12.741 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T12:43:12.741 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-06T12:43:12.742 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-06T12:43:12.742 INFO:teuthology.provision.fog.smithi158:Deploy complete!
2023-10-06T12:43:12.764 DEBUG:teuthology.parallel:result is None
2023-10-06T12:43:12.881 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com
2023-10-06T12:43:12.893 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-06T12:43:12.920 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server
2023-10-06T12:43:12.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com'
2023-10-06T12:43:12.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-06T12:43:13.001 DEBUG:teuthology.orchestra.run.smithi158:> true
2023-10-06T12:43:13.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com'
2023-10-06T12:43:13.097 DEBUG:teuthology.orchestra.run.smithi158:> uname -m
2023-10-06T12:43:13.152 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64
2023-10-06T12:43:13.206 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release
2023-10-06T12:43:13.220 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream"
2023-10-06T12:43:13.248 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="9"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="9"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el9"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:LOGO="fedora-logo-icon"
2023-10-06T12:43:13.249 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-06T12:43:13.250 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/"
2023-10-06T12:43:13.250 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-06T12:43:13.250 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-06T12:43:13.250 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-06T12:43:13.250 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server
2023-10-06T12:43:13.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:43:13.453 INFO:teuthology.dispatcher.supervisor:Running job 7412543
2023-10-06T12:43:13.515 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412543 --name yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi --description rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} -- /home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412543/orig.config.yaml
2023-10-06T12:43:13.519 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412543
2023-10-06T12:43:13.519 INFO:teuthology.dispatcher.supervisor:Job PID: 2736740
2023-10-06T12:43:13.519 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-06T12:45:13.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:47:13.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:49:13.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:51:14.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:53:14.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:55:14.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:57:14.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T12:59:14.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:01:14.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:03:15.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:05:15.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:07:15.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:09:15.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:11:15.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-06T13:11:15.902 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-06T13:11:15.961 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-06T13:11:15.962 INFO:teuthology.nuke:Checking targets against current locks
2023-10-06T13:11:16.007 DEBUG:teuthology.nuke:shortname: smithi158
2023-10-06T13:11:16.008 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-06T13:11:16.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:58:21-rados-wip-yuri7-testing-2023-10-04-1350-reef-distro-default-smithi/7412543', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 12:37:41.764076', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA05Kx+J1MSuX6jK67+gnPAkhvmzVXhZQTVPxl4Ss5kGILXBKeKuCvKjyNzUVAOBZndM/viYShSXJr0p0SznrE8='}
2023-10-06T13:11:16.079 INFO:teuthology.orchestra.console.smithi158:Power off
2023-10-06T13:11:16.079 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-06T13:11:16.100 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off
2023-10-06T13:11:16.100 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-06T13:11:16.120 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off
2023-10-06T13:11:16.221 INFO:teuthology.orchestra.console.smithi158:Power off completed
2023-10-06T13:11:16.376 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com