2023-11-27T02:16:41.063 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T02:16:41.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:16:41.173 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe05b1d6670>, signals=[15]) 2023-11-27T02:16:41.173 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-11-27T02:16:41.173 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-11-27T02:16:41.174 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-11-27T02:16:41.324 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10) 2023-11-27T02:16:41.372 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream 2023-11-27T02:16:41.907 INFO:teuthology.orchestra.console.smithi039:Power off 2023-11-27T02:16:41.907 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-27T02:16:41.928 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-11-27T02:16:41.928 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T02:16:41.949 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-11-27T02:16:45.950 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T02:16:46.058 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-11-27T02:16:50.063 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T02:16:50.170 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-11-27T02:16:50.271 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-11-27T02:16:50.372 INFO:teuthology.orchestra.console.smithi039:Power on 2023-11-27T02:16:50.372 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-27T02:16:50.392 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2023-11-27T02:16:50.393 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T02:16:50.413 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-11-27T02:16:54.418 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T02:16:54.527 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-11-27T02:16:58.532 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-27T02:16:58.639 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-11-27T02:16:58.739 INFO:teuthology.orchestra.console.smithi039:Power on completed 2023-11-27T02:16:58.840 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-11-27T02:20:50.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:20:53.346 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:20:59.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:02.434 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:21:08.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:11.490 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:21:17.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:20.582 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:21:26.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:29.666 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:21:35.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:38.722 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:21:44.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:47.810 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:21:53.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:21:56.870 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:22:02.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:22:05.954 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-11-27T02:22:11.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:23:12.020 WARNING:teuthology.provision.fog.smithi039:timed out 2023-11-27T02:23:18.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:23:18.265 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-27T02:23:18.266 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-27T02:23:18.580 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-11-27T02:23:18.581 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2023-11-27T02:23:18.595 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-11-27T02:23:18.596 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2023-11-27T02:23:18.652 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-11-27T02:23:18.652 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-11-27T02:23:18.759 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2023-11-27T02:23:18.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2023-11-27T02:23:18.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2023-11-27T02:23:18.932 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-11-27T02:23:19.003 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-11-27T02:23:19.058 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2023-11-27T02:23:19.059 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T02:23:19.059 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2023-11-27T02:23:19.059 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T02:23:19.059 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T02:23:19.059 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T02:23:19.059 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-11-27T02:23:19.060 DEBUG:teuthology.parallel:result is None 2023-11-27T02:23:19.181 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-11-27T02:23:19.182 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-27T02:23:19.209 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-11-27T02:23:19.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-27T02:23:19.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T02:23:19.303 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-11-27T02:23:19.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-11-27T02:23:19.368 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-11-27T02:23:19.422 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-11-27T02:23:19.423 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2023-11-27T02:23:19.478 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-27T02:23:19.479 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2023-11-27T02:23:19.479 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-27T02:23:19.479 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-27T02:23:19.479 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-27T02:23:19.479 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-11-27T02:23:19.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:23:19.590 INFO:teuthology.dispatcher.supervisor:Running job 7467454 2023-11-27T02:23:19.590 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-11-27_02:15:02-crimson-rados-wip-yingxin-crimson-improve-mempool5-distro-default-smithi/7467454 --name yingxin-2023-11-27_02:15:02-crimson-rados-wip-yingxin-crimson-improve-mempool5-distro-default-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/archive/yingxin-2023-11-27_02:15:02-crimson-rados-wip-yingxin-crimson-improve-mempool5-distro-default-smithi/7467454/orig.config.yaml 2023-11-27T02:23:19.592 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-11-27_02:15:02-crimson-rados-wip-yingxin-crimson-improve-mempool5-distro-default-smithi/7467454 2023-11-27T02:23:19.592 INFO:teuthology.dispatcher.supervisor:Job PID: 3907210 2023-11-27T02:23:19.593 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-27T02:25:19.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:27:19.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:29:20.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:31:20.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:33:20.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:35:20.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:37:20.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:39:20.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:41:21.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:43:21.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:45:21.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:47:21.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:49:21.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:51:21.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:53:21.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:55:22.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:57:22.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T02:57:22.385 INFO:teuthology.dispatcher.supervisor:Success! 2023-11-27T02:57:22.506 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-11-27T02:57:22.556 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com