2024-04-16T07:27:23.764 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T07:27:23.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:27:23.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa627a5dc10>, signals=[15]) 2024-04-16T07:27:23.870 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-04-16T07:27:23.871 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-04-16T07:27:23.871 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-16T07:27:24.009 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2024-04-16T07:27:24.052 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2024-04-16T07:27:24.380 INFO:teuthology.orchestra.console.smithi029:Power off 2024-04-16T07:27:24.381 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T07:27:24.401 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-04-16T07:27:24.402 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T07:27:24.422 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-16T07:27:24.523 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-04-16T07:27:24.624 INFO:teuthology.orchestra.console.smithi029:Power on 2024-04-16T07:27:24.624 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-16T07:27:24.646 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-04-16T07:27:24.646 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T07:27:24.668 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-16T07:27:28.672 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T07:27:28.779 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-16T07:27:28.880 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-04-16T07:27:28.981 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-04-16T07:30:30.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:30:33.950 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-16T07:30:39.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:30:43.010 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-16T07:30:49.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:30:52.098 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-16T07:30:58.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:31:01.186 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-16T07:31:07.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:31:10.270 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-16T07:31:16.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:32:16.336 WARNING:teuthology.provision.fog.smithi029:timed out 2024-04-16T07:32:22.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:32:22.624 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-16T07:32:22.624 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-16T07:32:22.980 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-04-16T07:32:22.980 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-04-16T07:32:22.996 INFO:teuthology.orchestra.run.smithi029.stdout:smithi046 2024-04-16T07:32:22.997 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi046 /etc/hosts 2024-04-16T07:32:23.053 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-16T07:32:23.054 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-04-16T07:32:23.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi046/smithi029/g' /etc/hosts 2024-04-16T07:32:23.262 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.46/172.21.15.29/g' /etc/hosts 2024-04-16T07:32:23.335 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi046/smithi029/g' /etc/hostname 2024-04-16T07:32:23.409 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-04-16T07:32:23.496 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-16T07:32:23.510 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-16T07:32:23.510 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-04-16T07:32:23.510 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-16T07:32:23.510 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-16T07:32:23.510 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T07:32:23.511 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T07:32:23.512 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-04-16T07:32:23.513 DEBUG:teuthology.parallel:result is None 2024-04-16T07:32:23.649 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-04-16T07:32:23.650 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-16T07:32:23.671 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-04-16T07:32:23.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-16T07:32:23.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T07:32:23.773 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-16T07:32:23.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-16T07:32:23.841 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-16T07:32:23.895 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-16T07:32:23.896 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-16T07:32:23.950 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-16T07:32:23.950 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-04-16T07:32:23.950 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-16T07:32:23.950 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-16T07:32:23.950 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T07:32:23.951 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T07:32:23.952 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-16T07:32:23.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:32:24.072 INFO:teuthology.dispatcher.supervisor:Running job 7658001 2024-04-16T07:32:24.073 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2024-04-16_07:26:08-crimson-rados-wip-matanb-crimson-replicated-april-15-distro-crimson-smithi/7658001 --name matan-2024-04-16_07:26:08-crimson-rados-wip-matanb-crimson-replicated-april-15-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/archive/matan-2024-04-16_07:26:08-crimson-rados-wip-matanb-crimson-replicated-april-15-distro-crimson-smithi/7658001/orig.config.yaml 2024-04-16T07:32:24.075 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2024-04-16_07:26:08-crimson-rados-wip-matanb-crimson-replicated-april-15-distro-crimson-smithi/7658001 2024-04-16T07:32:24.076 INFO:teuthology.dispatcher.supervisor:Job PID: 3223278 2024-04-16T07:32:24.076 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-16T07:34:24.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:36:24.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:38:24.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:40:24.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:42:24.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:44:25.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:46:25.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:48:25.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:50:25.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:52:25.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:54:26.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T07:54:26.119 INFO:teuthology.dispatcher.supervisor:Success! 2024-04-16T07:54:26.199 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2024-04-16T07:54:26.241 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com