2023-10-18T02:58:57.252 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T02:58:57.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T02:58:57.353 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2ae3da4670>, signals=[15]) 2023-10-18T02:58:57.355 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-10-18T02:58:57.355 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T02:58:57.355 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-18T02:58:57.378 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-10-18T02:58:57.449 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-18T02:58:57.490 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2023-10-18T02:58:57.490 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 10} 2023-10-18T02:58:57.537 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2023-10-18T02:58:57.537 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T02:58:57.593 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T02:58:57.633 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-10-18T02:58:57.689 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T02:58:57.768 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-18T02:58:57.769 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T02:58:57.791 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-18T02:58:57.792 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:58:57.814 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T02:59:01.818 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:59:01.927 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T02:59:05.930 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:59:06.039 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T02:59:10.042 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:59:10.150 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-18T02:59:10.251 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-18T02:59:10.354 INFO:teuthology.orchestra.console.smithi059:Power on 2023-10-18T02:59:10.354 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T02:59:10.378 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-10-18T02:59:10.378 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:59:10.400 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-18T02:59:14.402 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T02:59:14.511 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T02:59:14.612 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-10-18T02:59:14.713 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-10-18T02:59:14.713 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T02:59:29.782 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T02:59:44.850 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T02:59:59.920 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:00:14.994 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:00:30.070 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:00:45.145 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:01:00.218 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:01:15.290 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:01:30.370 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:01:45.440 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T03:01:45.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:02:03.902 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T03:02:09.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:02:12.986 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T03:02:18.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:02:22.046 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T03:02:28.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:02:31.130 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T03:02:37.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:03:37.199 WARNING:teuthology.provision.fog.smithi059:timed out 2023-10-18T03:03:43.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:03:43.454 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T03:03:43.455 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T03:03:43.779 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-10-18T03:03:43.779 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-10-18T03:03:43.794 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-10-18T03:03:43.794 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-10-18T03:03:43.849 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-10-18T03:03:43.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-18T03:03:43.958 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-10-18T03:03:43.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-10-18T03:03:44.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-10-18T03:03:44.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-18T03:03:44.201 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-18T03:03:44.256 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-18T03:03:44.256 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-10-18T03:03:44.256 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-18T03:03:44.257 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-18T03:03:44.257 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-10-18T03:03:44.257 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-10-18T03:03:44.257 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T03:03:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-18T03:03:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-10-18T03:03:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T03:03:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-18T03:03:44.258 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T03:03:44.259 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T03:03:44.259 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T03:03:44.260 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-10-18T03:03:44.261 DEBUG:teuthology.parallel:result is None 2023-10-18T03:03:44.385 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-10-18T03:03:44.386 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T03:03:44.411 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-10-18T03:03:44.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-18T03:03:44.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T03:03:44.506 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-18T03:03:44.572 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-18T03:03:44.572 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-18T03:03:44.626 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-18T03:03:44.627 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-18T03:03:44.682 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-18T03:03:44.682 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-10-18T03:03:44.682 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-18T03:03:44.682 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-18T03:03:44.683 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-10-18T03:03:44.683 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-10-18T03:03:44.683 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T03:03:44.683 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-18T03:03:44.683 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-10-18T03:03:44.684 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T03:03:44.684 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-18T03:03:44.684 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T03:03:44.684 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T03:03:44.684 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T03:03:44.685 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-18T03:03:44.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:03:44.797 INFO:teuthology.dispatcher.supervisor:Running job 7431248 2023-10-18T03:03:44.798 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi/7431248 --name yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_write} -- /home/teuthworker/archive/yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi/7431248/orig.config.yaml 2023-10-18T03:03:44.801 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-10-18_02:44:02-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-3-distro-default-smithi/7431248 2023-10-18T03:03:44.802 INFO:teuthology.dispatcher.supervisor:Job PID: 2351137 2023-10-18T03:03:44.802 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T03:05:44.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:07:45.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:09:45.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:11:45.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:13:45.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:15:45.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:17:45.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:19:45.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:21:46.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:23:46.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:25:46.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T03:25:46.561 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T03:25:46.643 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-10-18T03:25:46.686 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com