2024-01-18T14:17:02.217 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-18T14:17:02.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:17:02.324 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f39efa9fc10>, signals=[15]) 2024-01-18T14:17:02.324 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging 2024-01-18T14:17:02.325 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server 2024-01-18T14:17:02.325 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-01-18T14:17:02.458 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10) 2024-01-18T14:17:02.501 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream 2024-01-18T14:17:02.752 INFO:teuthology.orchestra.console.smithi106:Power off 2024-01-18T14:17:02.752 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-18T14:17:02.773 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-01-18T14:17:02.773 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:02.794 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-01-18T14:17:06.796 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:06.904 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-01-18T14:17:10.911 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:11.020 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-01-18T14:17:15.024 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:15.132 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-01-18T14:17:15.233 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-01-18T14:17:15.334 INFO:teuthology.orchestra.console.smithi106:Power on 2024-01-18T14:17:15.334 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-18T14:17:15.355 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On 2024-01-18T14:17:15.356 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:15.376 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-01-18T14:17:19.378 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:19.486 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-01-18T14:17:23.488 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-18T14:17:23.634 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-01-18T14:17:23.735 INFO:teuthology.orchestra.console.smithi106:Power on completed 2024-01-18T14:17:23.835 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2024-01-18T14:19:54.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:20:13.244 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-01-18T14:20:19.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:20:22.304 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-01-18T14:20:28.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:20:31.388 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-01-18T14:20:37.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:20:40.480 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-01-18T14:20:46.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:20:49.564 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-01-18T14:20:55.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:21:55.633 WARNING:teuthology.provision.fog.smithi106:timed out 2024-01-18T14:22:01.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:22:01.952 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-18T14:22:01.952 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-18T14:22:02.257 INFO:teuthology.provision.fog.smithi106:Node is ready 2024-01-18T14:22:02.257 DEBUG:teuthology.orchestra.run.smithi106:> hostname 2024-01-18T14:22:02.271 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2024-01-18T14:22:02.271 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2024-01-18T14:22:02.329 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2024-01-18T14:22:02.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-01-18T14:22:02.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2024-01-18T14:22:02.487 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2024-01-18T14:22:02.558 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2024-01-18T14:22:02.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2024-01-18T14:22:02.698 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-01-18T14:22:02.756 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-01-18T14:22:02.756 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-01-18T14:22:02.756 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-18T14:22:02.757 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-18T14:22:02.758 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2024-01-18T14:22:02.759 DEBUG:teuthology.parallel:result is None 2024-01-18T14:22:02.879 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2024-01-18T14:22:02.879 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-18T14:22:02.944 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2024-01-18T14:22:02.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-01-18T14:22:02.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-18T14:22:03.031 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-01-18T14:22:03.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-01-18T14:22:03.101 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-01-18T14:22:03.158 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-01-18T14:22:03.159 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-01-18T14:22:03.216 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-01-18T14:22:03.216 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-01-18T14:22:03.216 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-01-18T14:22:03.216 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-18T14:22:03.217 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-18T14:22:03.218 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-01-18T14:22:03.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:22:03.333 INFO:teuthology.dispatcher.supervisor:Running job 7520314 2024-01-18T14:22:03.333 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2024-01-18_13:55:25-crimson-rados-wip-matanb-crimson-testing-18.1-crimson-only-distro-crimson-smithi/7520314 --name matan-2024-01-18_13:55:25-crimson-rados-wip-matanb-crimson-testing-18.1-crimson-only-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/archive/matan-2024-01-18_13:55:25-crimson-rados-wip-matanb-crimson-testing-18.1-crimson-only-distro-crimson-smithi/7520314/orig.config.yaml 2024-01-18T14:22:03.336 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2024-01-18_13:55:25-crimson-rados-wip-matanb-crimson-testing-18.1-crimson-only-distro-crimson-smithi/7520314 2024-01-18T14:22:03.337 INFO:teuthology.dispatcher.supervisor:Job PID: 1483189 2024-01-18T14:22:03.337 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-18T14:24:03.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:26:03.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:28:03.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:30:03.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:32:04.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:34:04.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:36:04.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:38:04.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-18T14:38:04.695 INFO:teuthology.dispatcher.supervisor:Success! 2024-01-18T14:38:04.771 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2024-01-18T14:38:04.810 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com