2023-12-04T08:39:46.078 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T08:39:46.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:39:46.191 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f953415e550>, signals=[15]) 2023-12-04T08:39:46.192 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-12-04T08:39:46.192 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-12-04T08:39:46.192 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-12-04T08:39:46.328 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2023-12-04T08:39:46.372 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2023-12-04T08:39:47.007 INFO:teuthology.orchestra.console.smithi012:Power off 2023-12-04T08:39:47.007 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-04T08:39:47.028 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-12-04T08:39:47.028 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T08:39:47.048 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-04T08:39:51.053 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T08:39:51.162 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-04T08:39:55.167 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T08:39:55.275 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T08:39:55.376 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-12-04T08:39:55.477 INFO:teuthology.orchestra.console.smithi012:Power on 2023-12-04T08:39:55.477 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-04T08:39:55.498 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-12-04T08:39:55.499 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T08:39:55.519 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T08:39:59.524 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T08:39:59.633 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-12-04T08:40:03.638 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-04T08:40:03.746 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-12-04T08:40:03.847 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-12-04T08:40:03.947 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-12-04T08:45:23.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:45:26.499 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T08:45:32.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:45:35.554 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T08:45:41.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:45:44.642 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T08:45:50.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:45:53.730 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T08:45:59.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:46:02.786 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-12-04T08:46:08.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:47:08.854 WARNING:teuthology.provision.fog.smithi012:timed out 2023-12-04T08:47:14.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:47:15.118 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-04T08:47:15.119 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-04T08:47:15.465 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-12-04T08:47:15.465 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-12-04T08:47:15.481 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-12-04T08:47:15.481 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-12-04T08:47:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-12-04T08:47:15.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-12-04T08:47:15.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-12-04T08:47:15.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-12-04T08:47:15.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-12-04T08:47:15.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-12-04T08:47:15.885 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-12-04T08:47:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-12-04T08:47:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-12-04T08:47:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-12-04T08:47:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-12-04T08:47:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-12-04T08:47:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T08:47:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T08:47:15.942 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-12-04T08:47:15.943 DEBUG:teuthology.parallel:result is None 2023-12-04T08:47:16.064 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-12-04T08:47:16.064 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-04T08:47:16.087 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-12-04T08:47:16.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-04T08:47:16.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T08:47:16.183 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-12-04T08:47:16.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-12-04T08:47:16.253 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-12-04T08:47:16.308 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-12-04T08:47:16.308 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-12-04T08:47:16.363 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T08:47:16.364 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T08:47:16.365 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-12-04T08:47:16.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:47:16.476 INFO:teuthology.dispatcher.supervisor:Running job 7476796 2023-12-04T08:47:16.476 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-12-04_08:39:13-crimson-rados-wip-matanb-crimson-submit-error-cleanup-testing-distro-crimson-smithi/7476796 --name matan-2023-12-04_08:39:13-crimson-rados-wip-matanb-crimson-submit-error-cleanup-testing-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/sample_radosbench} -- /home/teuthworker/archive/matan-2023-12-04_08:39:13-crimson-rados-wip-matanb-crimson-submit-error-cleanup-testing-distro-crimson-smithi/7476796/orig.config.yaml 2023-12-04T08:47:16.480 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-12-04_08:39:13-crimson-rados-wip-matanb-crimson-submit-error-cleanup-testing-distro-crimson-smithi/7476796 2023-12-04T08:47:16.480 INFO:teuthology.dispatcher.supervisor:Job PID: 980735 2023-12-04T08:47:16.480 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-04T08:49:16.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:51:16.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:53:16.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:55:17.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:57:17.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T08:59:17.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:01:17.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:03:17.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:05:18.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:07:18.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:09:18.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:11:18.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T09:11:18.665 INFO:teuthology.dispatcher.supervisor:Success! 2023-12-04T09:11:23.504 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-12-04T09:11:23.556 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com