2023-12-08T21:39:49.753 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-08T21:39:49.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:39:49.858 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8de910f550>, signals=[15]) 2023-12-08T21:39:49.859 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-12-08T21:39:49.859 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-12-08T21:39:49.859 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-08T21:39:50.015 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2023-12-08T21:39:50.067 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2023-12-08T21:39:50.526 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-08T21:39:50.526 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T21:39:50.551 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-08T21:39:50.552 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:39:50.576 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-08T21:39:54.578 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:39:54.687 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-08T21:39:58.690 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:39:58.799 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-08T21:39:58.900 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-08T21:39:59.001 INFO:teuthology.orchestra.console.smithi195:Power on 2023-12-08T21:39:59.001 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-08T21:39:59.024 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-12-08T21:39:59.025 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:39:59.047 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-08T21:40:03.051 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:40:03.160 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-08T21:40:07.164 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T21:40:07.272 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-08T21:40:07.373 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-12-08T21:40:07.473 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-12-08T21:42:38.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:42:41.349 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-08T21:42:47.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:42:50.434 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-08T21:42:56.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:42:59.490 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-08T21:43:05.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:43:08.546 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-08T21:43:14.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:43:17.634 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-08T21:43:23.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:43:26.694 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-08T21:43:32.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:44:32.759 WARNING:teuthology.provision.fog.smithi195:timed out 2023-12-08T21:44:38.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:44:38.974 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-08T21:44:38.975 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-08T21:44:39.323 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-12-08T21:44:39.324 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-12-08T21:44:39.339 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-12-08T21:44:39.339 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-12-08T21:44:39.395 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-12-08T21:44:39.395 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-08T21:44:39.499 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-12-08T21:44:39.528 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-12-08T21:44:39.598 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-12-08T21:44:39.665 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-08T21:44:39.731 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-08T21:44:39.786 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-12-08T21:44:39.786 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-12-08T21:44:39.786 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-08T21:44:39.787 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T21:44:39.788 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-12-08T21:44:39.790 DEBUG:teuthology.parallel:result is None 2023-12-08T21:44:39.916 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2023-12-08T21:44:39.916 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-08T21:44:39.938 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2023-12-08T21:44:39.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-08T21:44:39.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-08T21:44:40.060 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-12-08T21:44:40.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-12-08T21:44:40.125 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-12-08T21:44:40.179 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-12-08T21:44:40.180 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-08T21:44:40.233 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-08T21:44:40.234 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-12-08T21:44:40.238 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-08T21:44:40.238 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-12-08T21:44:40.239 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-08T21:44:40.239 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-08T21:44:40.239 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-08T21:44:40.240 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-08T21:44:40.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:44:40.344 INFO:teuthology.dispatcher.supervisor:Running job 7485161 2023-12-08T21:44:40.345 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-12-08_21:29:05-rbd-main-distro-default-smithi/7485161 --name dis-2023-12-08_21:29:05-rbd-main-distro-default-smithi --description rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} conf/{disable-pool-app} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_defaults} -- /home/teuthworker/archive/dis-2023-12-08_21:29:05-rbd-main-distro-default-smithi/7485161/orig.config.yaml 2023-12-08T21:44:40.348 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-12-08_21:29:05-rbd-main-distro-default-smithi/7485161 2023-12-08T21:44:40.349 INFO:teuthology.dispatcher.supervisor:Job PID: 2197447 2023-12-08T21:44:40.349 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-08T21:46:40.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:48:40.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:50:40.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:52:40.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:54:41.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:56:41.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T21:58:41.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:00:41.634 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:02:41.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:04:41.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:06:42.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:08:42.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:10:42.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:12:42.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:14:42.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:16:42.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:18:43.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:20:43.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:22:43.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:24:43.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:26:43.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:28:44.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:30:44.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:32:44.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:34:44.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:36:44.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:38:44.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:40:45.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:42:45.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:44:45.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:46:45.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:48:45.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:50:45.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:52:46.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:54:46.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:56:46.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T22:58:46.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:00:46.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:02:47.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:04:47.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:06:47.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:08:47.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:10:47.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-08T23:10:47.768 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-08T23:10:47.930 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-08T23:10:47.930 INFO:teuthology.nuke:Checking targets against current locks 2023-12-08T23:10:47.973 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-08T23:10:47.974 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-08T23:10:47.997 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-08_21:29:05-rbd-main-distro-default-smithi/7485161', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 21:39:48.952543', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJLNcazG2K0KaJR+sCfeeImd82P9aboEn+UBogLYo2ttkPGtvvWri5uYmFDAoF7eT0dxI4EHH7340vMDTfP68A='} 2023-12-08T23:10:48.041 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-08T23:10:48.042 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-08T23:10:48.067 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-08T23:10:48.067 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-08T23:10:48.089 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-08T23:10:48.190 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-08T23:10:48.333 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com