2023-10-18T02:50:23.587 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T02:50:23.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T02:50:23.713 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff2190c0670>, signals=[15]) 2023-10-18T02:50:23.715 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2023-10-18T02:50:23.715 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T02:50:23.715 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-10-18T02:50:23.739 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /host {"name": "smithi005"} 2023-10-18T02:50:23.807 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-18T02:50:23.855 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_9.stream (ID 10) 2023-10-18T02:50:23.856 DEBUG:teuthology.provision.fog.smithi005:FOG request: PUT /host/111 {"imageID": 10} 2023-10-18T02:50:23.897 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 9.stream 2023-10-18T02:50:23.898 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:50:23.958 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T02:50:23.999 DEBUG:teuthology.provision.fog.smithi005:FOG request: POST /host/111/task {"taskTypeID": 1} 2023-10-18T02:50:24.049 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:50:24.142 INFO:teuthology.orchestra.console.smithi005:Power off 2023-10-18T02:50:24.144 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T02:50:24.167 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-10-18T02:50:24.167 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:50:24.192 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-18T02:50:28.197 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:50:28.305 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-18T02:50:32.307 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:50:32.415 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-10-18T02:50:32.516 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-10-18T02:50:32.617 INFO:teuthology.orchestra.console.smithi005:Power on 2023-10-18T02:50:32.618 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T02:50:32.639 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2023-10-18T02:50:32.640 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:50:32.659 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-10-18T02:50:36.662 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:50:36.772 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-10-18T02:50:40.774 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:50:40.883 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-10-18T02:50:40.984 INFO:teuthology.orchestra.console.smithi005:Power on completed 2023-10-18T02:50:41.085 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2023-10-18T02:50:41.085 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:50:56.158 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:51:11.234 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:51:26.314 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:51:41.390 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:51:56.467 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:52:11.542 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:52:26.618 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:52:41.701 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:52:56.764 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:53:11.846 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None 2023-10-18T02:53:11.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:53:30.362 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-10-18T02:53:36.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:53:39.422 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-10-18T02:53:45.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:53:48.506 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-10-18T02:53:54.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:53:57.562 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-10-18T02:54:03.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:55:03.627 WARNING:teuthology.provision.fog.smithi005:timed out 2023-10-18T02:55:09.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:55:09.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T02:55:09.894 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T02:55:10.225 INFO:teuthology.provision.fog.smithi005:Node is ready 2023-10-18T02:55:10.226 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2023-10-18T02:55:10.242 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2023-10-18T02:55:10.242 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2023-10-18T02:55:10.298 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2023-10-18T02:55:10.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-10-18T02:55:10.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2023-10-18T02:55:10.451 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2023-10-18T02:55:10.524 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2023-10-18T02:55:10.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-10-18T02:55:10.667 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-10-18T02:55:10.722 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-10-18T02:55:10.722 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2023-10-18T02:55:10.723 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-10-18T02:55:10.723 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-10-18T02:55:10.723 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2023-10-18T02:55:10.723 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2023-10-18T02:55:10.723 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T02:55:10.724 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-10-18T02:55:10.724 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2023-10-18T02:55:10.724 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T02:55:10.724 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-10-18T02:55:10.724 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T02:55:10.725 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T02:55:10.725 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T02:55:10.726 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2023-10-18T02:55:10.730 DEBUG:teuthology.parallel:result is None 2023-10-18T02:55:10.880 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2023-10-18T02:55:10.881 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T02:55:10.905 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2023-10-18T02:55:10.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-18T02:55:10.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T02:55:11.000 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-10-18T02:55:11.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-10-18T02:55:11.065 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-10-18T02:55:11.120 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-10-18T02:55:11.120 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-10-18T02:55:11.174 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2023-10-18T02:55:11.175 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2023-10-18T02:55:11.175 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2023-10-18T02:55:11.175 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2023-10-18T02:55:11.175 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2023-10-18T02:55:11.175 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2023-10-18T02:55:11.176 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T02:55:11.176 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-10-18T02:55:11.176 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2023-10-18T02:55:11.176 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T02:55:11.176 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2023-10-18T02:55:11.176 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T02:55:11.177 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T02:55:11.177 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T02:55:11.177 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-10-18T02:55:11.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T02:55:11.285 INFO:teuthology.dispatcher.supervisor:Running job 7431241 2023-10-18T02:55:11.285 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi/7431241 --name yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4K_rand_rw} -- /home/teuthworker/archive/yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi/7431241/orig.config.yaml 2023-10-18T02:55:11.288 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi/7431241 2023-10-18T02:55:11.289 INFO:teuthology.dispatcher.supervisor:Job PID: 2293179 2023-10-18T02:55:11.289 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T02:57:11.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T02:59:11.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:01:11.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:03:11.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:05:12.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:07:12.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:09:12.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:11:12.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:13:12.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:15:12.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:15:12.939 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T03:15:13.020 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-10-18T03:15:13.074 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com