2023-11-09T03:29:49.934 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T03:29:49.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:29:50.036 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f131fb62670>, signals=[15]) 2023-11-09T03:29:50.037 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-11-09T03:29:50.037 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T03:29:50.038 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-09T03:29:50.060 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-11-09T03:29:50.138 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-09T03:29:50.188 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_9.stream (ID 10) 2023-11-09T03:29:50.189 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 10} 2023-11-09T03:29:50.237 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 9.stream 2023-11-09T03:29:50.238 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:29:50.315 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T03:29:50.353 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-11-09T03:29:50.420 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:29:50.535 INFO:teuthology.orchestra.console.smithi152:Power off 2023-11-09T03:29:50.536 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T03:29:50.565 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-11-09T03:29:50.566 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:29:50.591 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-09T03:29:50.693 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-11-09T03:29:50.793 INFO:teuthology.orchestra.console.smithi152:Power on 2023-11-09T03:29:50.794 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T03:29:50.823 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-11-09T03:29:50.823 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:29:50.849 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-09T03:29:54.850 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:29:54.964 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-09T03:29:58.966 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:29:59.083 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-09T03:29:59.184 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-11-09T03:29:59.285 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-11-09T03:29:59.285 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:30:14.378 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:30:29.458 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:30:44.550 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:30:59.642 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:31:14.738 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:31:29.828 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:31:44.922 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:32:00.014 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:32:15.103 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:32:30.190 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:32:45.266 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-11-09T03:32:45.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:32:48.414 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:32:54.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:32:57.502 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:33:03.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:33:06.590 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:33:12.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:33:15.674 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:33:21.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:33:24.762 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:33:30.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:33:33.850 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:33:39.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:33:42.942 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:33:48.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:34:07.483 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:34:13.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:34:16.570 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-09T03:34:22.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:34:32.728 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T03:34:32.730 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T03:34:52.948 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-11-09T03:34:52.948 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-11-09T03:34:52.967 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-11-09T03:34:52.968 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-11-09T03:34:53.026 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-11-09T03:34:53.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-11-09T03:34:53.175 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-11-09T03:34:53.206 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-11-09T03:34:53.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-11-09T03:34:53.345 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-11-09T03:34:53.413 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-09T03:34:53.469 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-11-09T03:34:53.469 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-11-09T03:34:53.470 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-11-09T03:34:53.470 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-11-09T03:34:53.470 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-11-09T03:34:53.470 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-11-09T03:34:53.471 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-09T03:34:53.471 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-09T03:34:53.471 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-11-09T03:34:53.471 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-09T03:34:53.471 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-11-09T03:34:53.472 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T03:34:53.472 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-09T03:34:53.472 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-09T03:34:53.473 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-11-09T03:34:53.474 DEBUG:teuthology.parallel:result is None 2023-11-09T03:34:53.601 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-11-09T03:34:53.602 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T03:34:53.632 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-11-09T03:34:53.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-09T03:34:53.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T03:34:53.716 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-11-09T03:34:53.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-09T03:34:53.785 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-11-09T03:34:53.839 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-11-09T03:34:53.840 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-09T03:34:53.894 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-11-09T03:34:53.894 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-11-09T03:34:53.894 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-11-09T03:34:53.895 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-11-09T03:34:53.895 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-11-09T03:34:53.895 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-11-09T03:34:53.895 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-09T03:34:53.896 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-09T03:34:53.896 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-11-09T03:34:53.896 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-09T03:34:53.896 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-11-09T03:34:53.896 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T03:34:53.897 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-09T03:34:53.897 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-09T03:34:53.897 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-09T03:34:53.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:34:54.018 INFO:teuthology.dispatcher.supervisor:Running job 7452328 2023-11-09T03:34:54.018 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-11-09_02:08:12-crimson-rados-wip-yingxin-crimson-improve-mempool4-distro-default-smithi/7452328 --name yingxin-2023-11-09_02:08:12-crimson-rados-wip-yingxin-crimson-improve-mempool4-distro-default-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_write} -- /home/teuthworker/archive/yingxin-2023-11-09_02:08:12-crimson-rados-wip-yingxin-crimson-improve-mempool4-distro-default-smithi/7452328/orig.config.yaml 2023-11-09T03:34:54.022 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-11-09_02:08:12-crimson-rados-wip-yingxin-crimson-improve-mempool4-distro-default-smithi/7452328 2023-11-09T03:34:54.023 INFO:teuthology.dispatcher.supervisor:Job PID: 1175191 2023-11-09T03:34:54.023 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T03:36:54.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:38:54.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:40:54.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:42:54.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:44:54.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:46:54.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:48:55.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:50:55.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:50:55.316 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T03:50:55.394 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-11-09T03:50:55.440 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com