2024-04-16T23:48:07.703 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T23:48:07.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T23:48:07.805 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f984e0efc10>, signals=[15]) 2024-04-16T23:48:07.805 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2024-04-16T23:48:07.805 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2024-04-16T23:48:07.805 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-16T23:48:07.935 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10) 2024-04-16T23:48:07.979 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream 2024-04-16T23:48:08.238 INFO:teuthology.orchestra.console.smithi154:Power off 2024-04-16T23:48:08.239 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T23:48:08.260 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2024-04-16T23:48:08.261 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T23:48:08.285 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-16T23:48:12.288 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T23:48:12.397 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-16T23:48:16.401 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T23:48:16.510 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-16T23:48:20.511 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T23:48:20.621 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-16T23:48:20.721 INFO:teuthology.orchestra.console.smithi154:Power off completed 2024-04-16T23:48:20.822 INFO:teuthology.orchestra.console.smithi154:Power on 2024-04-16T23:48:20.822 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-16T23:48:20.844 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2024-04-16T23:48:20.844 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T23:48:20.866 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2024-04-16T23:48:24.870 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T23:48:24.979 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2024-04-16T23:48:25.079 INFO:teuthology.orchestra.console.smithi154:Power on completed 2024-04-16T23:48:25.180 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2024-04-16T23:51:11.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:51:14.174 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:51:20.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:51:23.230 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:51:29.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:51:32.286 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:51:38.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:51:41.406 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:51:47.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:51:50.498 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:51:56.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:51:59.582 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:52:05.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:52:08.670 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-16T23:52:14.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:53:14.735 WARNING:teuthology.provision.fog.smithi154:timed out 2024-04-16T23:53:20.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:53:20.991 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-16T23:53:20.992 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-16T23:53:21.302 INFO:teuthology.provision.fog.smithi154:Node is ready 2024-04-16T23:53:21.303 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2024-04-16T23:53:21.318 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2024-04-16T23:53:21.318 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2024-04-16T23:53:21.374 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2024-04-16T23:53:21.374 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-04-16T23:53:21.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2024-04-16T23:53:21.514 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2024-04-16T23:53:21.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2024-04-16T23:53:21.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2024-04-16T23:53:21.716 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-16T23:53:21.771 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-16T23:53:21.772 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T23:53:21.772 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-16T23:53:21.772 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T23:53:21.772 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T23:53:21.772 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T23:53:21.773 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2024-04-16T23:53:21.775 DEBUG:teuthology.parallel:result is None 2024-04-16T23:53:21.898 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2024-04-16T23:53:21.899 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-16T23:53:21.924 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2024-04-16T23:53:21.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-16T23:53:21.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T23:53:22.013 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-16T23:53:22.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-16T23:53:22.080 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-16T23:53:22.135 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-16T23:53:22.135 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-16T23:53:22.190 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2024-04-16T23:53:22.190 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2024-04-16T23:53:22.190 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2024-04-16T23:53:22.190 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2024-04-16T23:53:22.190 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T23:53:22.191 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T23:53:22.192 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-16T23:53:22.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T23:53:22.304 INFO:teuthology.dispatcher.supervisor:Running job 7659280 2024-04-16T23:53:22.304 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659280 --name yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi --description rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} -- /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659280/orig.config.yaml 2024-04-16T23:53:22.307 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-16_23:25:35-rados-wip-yuriw-testing-20240416.150233-distro-default-smithi/7659280 2024-04-16T23:53:22.308 INFO:teuthology.dispatcher.supervisor:Job PID: 2152876 2024-04-16T23:53:22.308 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-16T23:55:22.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T23:57:22.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T23:59:22.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:01:22.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:03:23.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:05:23.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:07:23.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:09:23.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:11:23.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:13:23.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:15:24.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:17:24.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:19:24.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:21:24.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:23:24.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:25:24.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:27:25.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:29:25.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:31:25.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:33:25.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:35:25.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:37:26.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:39:26.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:41:26.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:43:26.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:45:26.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:47:27.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:49:27.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:51:27.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:53:27.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:55:27.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:57:28.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T00:59:28.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:01:28.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:03:28.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:05:28.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:07:28.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:09:29.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:11:29.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:13:29.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:15:29.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:17:29.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:19:29.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:21:30.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:23:30.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:25:30.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:27:30.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:29:30.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:31:30.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T01:31:31.042 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1