2024-03-13T01:25:05.199 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-13T01:25:05.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:25:05.316 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6d090ebc10>, signals=[15]) 2024-03-13T01:25:05.316 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2024-03-13T01:25:05.316 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T01:25:05.317 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-03-13T01:25:05.459 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10) 2024-03-13T01:25:05.512 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream 2024-03-13T01:25:05.791 INFO:teuthology.orchestra.console.smithi163:Power off 2024-03-13T01:25:05.791 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T01:25:05.817 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-03-13T01:25:05.818 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T01:25:05.846 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-03-13T01:25:09.851 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T01:25:09.961 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-03-13T01:25:13.964 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T01:25:14.073 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-03-13T01:25:14.174 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-03-13T01:25:14.274 INFO:teuthology.orchestra.console.smithi163:Power on 2024-03-13T01:25:14.275 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T01:25:14.299 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2024-03-13T01:25:14.299 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T01:25:14.327 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-03-13T01:25:18.330 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T01:25:18.443 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-03-13T01:25:22.446 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T01:25:22.555 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-03-13T01:25:22.656 INFO:teuthology.orchestra.console.smithi163:Power on completed 2024-03-13T01:25:22.757 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2024-03-13T01:28:23.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:28:26.974 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:28:32.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:28:36.062 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:28:42.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:28:45.154 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:28:51.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:28:54.238 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:29:00.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:29:03.294 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:29:09.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:29:12.350 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:29:18.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:29:21.406 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:29:27.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:29:30.462 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-03-13T01:29:36.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:30:36.531 WARNING:teuthology.provision.fog.smithi163:timed out 2024-03-13T01:30:42.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:30:42.784 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T01:30:42.784 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T01:30:43.114 INFO:teuthology.provision.fog.smithi163:Node is ready 2024-03-13T01:30:43.114 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2024-03-13T01:30:43.129 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2024-03-13T01:30:43.129 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2024-03-13T01:30:43.186 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2024-03-13T01:30:43.186 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-03-13T01:30:43.303 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2024-03-13T01:30:43.332 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2024-03-13T01:30:43.399 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2024-03-13T01:30:43.467 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-03-13T01:30:43.534 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-03-13T01:30:43.589 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-03-13T01:30:43.589 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-13T01:30:43.590 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T01:30:43.591 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2024-03-13T01:30:43.593 DEBUG:teuthology.parallel:result is None 2024-03-13T01:30:43.714 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2024-03-13T01:30:43.714 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T01:30:43.737 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2024-03-13T01:30:43.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-03-13T01:30:43.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T01:30:43.825 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-03-13T01:30:43.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-03-13T01:30:43.888 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-03-13T01:30:43.943 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-03-13T01:30:43.943 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-03-13T01:30:43.996 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-03-13T01:30:43.996 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-03-13T01:30:43.996 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-03-13T01:30:43.996 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-03-13T01:30:43.996 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-03-13T01:30:43.996 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-13T01:30:43.997 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T01:30:43.997 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-03-13T01:30:44.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:30:44.102 INFO:teuthology.dispatcher.supervisor:Running job 7594438 2024-03-13T01:30:44.103 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-12_15:06:19-rados-wip-yuri8-testing-2024-03-11-1138-distro-default-smithi/7594438 --name yuriw-2024-03-12_15:06:19-rados-wip-yuri8-testing-2024-03-11-1138-distro-default-smithi --description rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/archive/yuriw-2024-03-12_15:06:19-rados-wip-yuri8-testing-2024-03-11-1138-distro-default-smithi/7594438/orig.config.yaml 2024-03-13T01:30:44.106 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-12_15:06:19-rados-wip-yuri8-testing-2024-03-11-1138-distro-default-smithi/7594438 2024-03-13T01:30:44.106 INFO:teuthology.dispatcher.supervisor:Job PID: 2122990 2024-03-13T01:30:44.106 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-13T01:32:44.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:34:44.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:36:44.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:38:44.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:40:44.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:42:45.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T01:42:45.143 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1