2024-03-20T06:04:47.615 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-20T06:04:47.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:04:47.725 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc16a909c10>, signals=[15]) 2024-03-20T06:04:47.726 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-03-20T06:04:47.726 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-03-20T06:04:47.726 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-20T06:04:47.857 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-03-20T06:04:47.917 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-03-20T06:04:48.190 INFO:teuthology.orchestra.console.smithi161:Power off 2024-03-20T06:04:48.190 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T06:04:48.220 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-03-20T06:04:48.221 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T06:04:48.243 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-20T06:04:52.246 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T06:04:52.355 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-20T06:04:56.359 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T06:04:56.468 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-20T06:04:56.569 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-03-20T06:04:56.669 INFO:teuthology.orchestra.console.smithi161:Power on 2024-03-20T06:04:56.670 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-20T06:04:56.691 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-03-20T06:04:56.692 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T06:04:56.712 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-20T06:05:00.716 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T06:05:00.824 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-20T06:05:04.829 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T06:05:04.938 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-20T06:05:05.039 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-03-20T06:05:05.139 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-03-20T06:07:36.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:07:39.070 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:07:45.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:07:48.158 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:07:54.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:07:57.214 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:08:03.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:08:06.270 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:08:12.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:08:15.330 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:08:21.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:08:24.418 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:08:30.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:08:33.502 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-20T06:08:39.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:09:39.567 WARNING:teuthology.provision.fog.smithi161:timed out 2024-03-20T06:09:45.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:09:45.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-20T06:09:45.856 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-20T06:09:46.178 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-03-20T06:09:46.179 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-03-20T06:09:46.193 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-03-20T06:09:46.193 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-03-20T06:09:46.249 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-03-20T06:09:46.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-20T06:09:46.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-03-20T06:09:46.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-03-20T06:09:46.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-03-20T06:09:46.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-20T06:09:46.583 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-20T06:09:46.638 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-03-20T06:09:46.639 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T06:09:46.639 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-20T06:09:46.639 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T06:09:46.639 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T06:09:46.639 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T06:09:46.640 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-03-20T06:09:46.641 DEBUG:teuthology.parallel:result is None 2024-03-20T06:09:46.791 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-03-20T06:09:46.791 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-20T06:09:46.815 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-03-20T06:09:46.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-20T06:09:46.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T06:09:46.904 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-20T06:09:46.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-20T06:09:46.973 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-03-20T06:09:47.027 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-03-20T06:09:47.027 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-20T06:09:47.081 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-20T06:09:47.081 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-03-20T06:09:47.081 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-20T06:09:47.081 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-20T06:09:47.081 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T06:09:47.082 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T06:09:47.083 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-20T06:09:47.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:09:47.192 INFO:teuthology.dispatcher.supervisor:Running job 7609843 2024-03-20T06:09:47.193 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-19_00:09:45-rados-wip-yuri5-testing-2024-03-18-1144-distro-default-smithi/7609843 --name yuriw-2024-03-19_00:09:45-rados-wip-yuri5-testing-2024-03-18-1144-distro-default-smithi --description rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} -- /home/teuthworker/archive/yuriw-2024-03-19_00:09:45-rados-wip-yuri5-testing-2024-03-18-1144-distro-default-smithi/7609843/orig.config.yaml 2024-03-20T06:09:47.199 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-19_00:09:45-rados-wip-yuri5-testing-2024-03-18-1144-distro-default-smithi/7609843 2024-03-20T06:09:47.200 INFO:teuthology.dispatcher.supervisor:Job PID: 3566078 2024-03-20T06:09:47.200 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-20T06:11:47.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:13:47.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:15:47.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:17:47.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:19:47.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:21:48.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:23:48.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:25:48.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:27:48.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:29:48.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:31:49.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:33:49.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:35:49.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:37:49.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:39:49.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:41:49.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:43:50.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:45:50.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:47:50.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:49:50.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:51:50.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:53:50.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:55:51.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:57:51.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T06:59:51.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:01:51.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:03:51.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:05:52.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:07:52.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:09:52.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:11:52.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:13:52.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:15:52.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:17:53.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:19:53.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:21:53.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:23:53.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:25:53.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:27:53.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:29:54.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:31:54.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:33:54.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:35:54.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:37:54.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:39:54.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:41:55.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:43:55.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:45:55.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:47:55.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T07:47:55.722 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1