2023-07-24T22:24:39.200 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-24T22:24:39.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:24:39.202 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:24:39.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f86e3b8a1f0>, signals=[15]) 2023-07-24T22:24:39.334 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-07-24T22:24:39.334 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T22:24:39.334 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-24T22:24:39.357 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-07-24T22:24:39.432 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-24T22:24:39.481 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-24T22:24:39.481 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 6} 2023-07-24T22:24:39.522 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of ubuntu 22.04 2023-07-24T22:24:39.522 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:24:39.571 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T22:24:39.603 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-07-24T22:24:39.656 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:24:39.748 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-24T22:24:39.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T22:24:39.773 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T22:24:39.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:24:39.795 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T22:24:43.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:24:44.906 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:24:48.907 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:24:50.016 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:24:54.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:24:55.130 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:24:59.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:00.244 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:04.245 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:05.356 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:09.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:10.470 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:14.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:15.582 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:19.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:20.694 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:24.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:25.805 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:29.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:30.919 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:34.921 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:35.036 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T22:25:35.137 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-24T22:25:35.238 INFO:teuthology.orchestra.console:Power on smithi159 2023-07-24T22:25:35.238 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T22:25:40.266 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T22:25:40.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:41.277 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:45.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:46.390 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:50.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:51.504 DEBUG:teuthology.orchestra.console:check power output: 2023-07-24T22:25:55.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T22:25:55.616 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T22:25:55.717 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-07-24T22:25:55.817 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-07-24T22:25:55.818 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:26:15.560 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:26:34.048 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:26:54.137 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:27:14.196 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:27:34.272 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:27:55.276 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:28:15.359 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:28:30.432 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:28:55.520 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:29:10.607 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-24T22:29:15.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:29:18.736 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-24T22:29:24.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:29:32.816 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-24T22:29:38.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:29:43.056 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-24T22:29:49.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:29:57.136 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-24T22:30:03.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:31:08.208 WARNING:teuthology.provision.fog.smithi159:timed out 2023-07-24T22:31:14.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:31:19.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T22:31:19.423 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T22:31:19.932 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-07-24T22:31:19.932 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-07-24T22:31:19.978 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-07-24T22:31:19.978 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-07-24T22:31:20.027 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-07-24T22:31:20.027 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-24T22:31:20.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-07-24T22:31:20.159 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-07-24T22:31:20.214 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-07-24T22:31:20.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-24T22:31:20.327 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-24T22:31:20.378 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-24T22:31:20.378 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="22.04" 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=jammy 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T22:31:20.379 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T22:31:20.380 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T22:31:20.380 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T22:31:20.380 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=jammy 2023-07-24T22:31:20.381 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-07-24T22:31:20.382 DEBUG:teuthology.parallel:result is None 2023-07-24T22:31:20.517 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-07-24T22:31:20.518 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T22:31:20.552 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-07-24T22:31:20.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-24T22:31:20.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T22:31:20.623 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-07-24T22:31:20.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-07-24T22:31:20.740 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-07-24T22:31:20.785 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-07-24T22:31:20.785 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-24T22:31:20.833 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-24T22:31:20.833 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-07-24T22:31:20.834 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="22.04" 2023-07-24T22:31:20.834 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-24T22:31:20.834 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=jammy 2023-07-24T22:31:20.834 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-07-24T22:31:20.835 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-07-24T22:31:20.835 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T22:31:20.835 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T22:31:20.835 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T22:31:20.835 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T22:31:20.835 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=jammy 2023-07-24T22:31:20.836 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-24T22:31:20.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:31:20.859 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:31:20.984 INFO:teuthology.dispatcher.supervisor:Running job 7349998 2023-07-24T22:31:20.984 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-24_21:23:58-rados-wip-yuri5-testing-2023-07-24-0814-distro-default-smithi/7349998 --name yuriw-2023-07-24_21:23:58-rados-wip-yuri5-testing-2023-07-24-0814-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} -- /home/teuthworker/archive/yuriw-2023-07-24_21:23:58-rados-wip-yuri5-testing-2023-07-24-0814-distro-default-smithi/7349998/orig.config.yaml 2023-07-24T22:31:20.988 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-24_21:23:58-rados-wip-yuri5-testing-2023-07-24-0814-distro-default-smithi/7349998 2023-07-24T22:31:20.989 INFO:teuthology.dispatcher.supervisor:Job PID: 18141 2023-07-24T22:31:20.989 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-24T22:33:21.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:33:21.089 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:35:26.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:35:26.265 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:37:31.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:37:31.454 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:39:36.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:39:36.673 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:41:41.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:41:41.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:43:45.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:43:45.186 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:45:50.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:45:50.365 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:47:55.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:47:55.558 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:50:00.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T22:50:00.734 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T22:50:02.813 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-24T22:50:07.903 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-07-24T22:50:17.980 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com