2023-08-15T16:20:45.821 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T16:20:45.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:20:45.929 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f34235f9e50>, signals=[15]) 2023-08-15T16:20:45.930 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-08-15T16:20:45.930 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-08-15T16:20:45.931 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-08-15T16:20:45.955 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-08-15T16:20:46.021 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-08-15T16:20:46.061 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-08-15T16:20:46.061 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 2} 2023-08-15T16:20:46.110 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2023-08-15T16:20:46.110 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:20:46.166 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-08-15T16:20:46.204 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-08-15T16:20:46.262 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:20:46.350 INFO:teuthology.orchestra.console.smithi167:Power off 2023-08-15T16:20:46.352 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-15T16:20:46.373 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-08-15T16:20:46.374 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T16:20:46.394 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-15T16:20:50.398 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T16:20:50.507 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-15T16:20:54.508 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T16:20:54.620 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-15T16:20:58.624 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T16:20:58.736 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-15T16:20:58.838 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-08-15T16:20:58.939 INFO:teuthology.orchestra.console.smithi167:Power on 2023-08-15T16:20:58.940 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-15T16:20:58.967 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-08-15T16:20:58.968 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T16:20:58.994 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-08-15T16:21:02.996 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-15T16:21:03.107 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-08-15T16:21:03.208 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-08-15T16:21:03.309 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-08-15T16:21:03.309 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:21:18.376 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:21:33.452 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:21:48.525 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:22:03.596 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:22:18.672 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:22:33.752 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:22:48.840 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:23:03.933 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:23:19.035 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:23:34.128 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:23:49.229 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:24:04.328 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:24:19.424 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:24:34.526 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:24:49.624 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:25:04.724 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-08-15T16:25:04.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:25:07.888 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:25:13.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:25:16.944 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:25:22.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:25:26.000 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:25:32.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:25:35.056 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:25:41.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:25:44.112 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:25:50.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:25:53.168 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:25:59.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:26:02.224 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-08-15T16:26:08.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:26:40.297 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-15T16:26:40.298 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-15T16:27:01.237 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-08-15T16:27:01.237 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-08-15T16:27:01.246 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-08-15T16:27:01.246 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-08-15T16:27:01.254 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-08-15T16:27:01.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-08-15T16:27:01.385 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-08-15T16:27:01.402 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-08-15T16:27:01.414 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-08-15T16:27:01.474 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-08-15T16:27:01.482 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-08-15T16:27:01.490 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-08-15T16:27:01.490 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T16:27:01.490 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-08-15T16:27:01.490 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-08-15T16:27:01.490 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T16:27:01.491 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-08-15T16:27:01.491 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T16:27:01.491 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T16:27:01.491 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T16:27:01.491 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T16:27:01.491 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-08-15T16:27:01.492 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-08-15T16:27:01.492 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-08-15T16:27:01.493 DEBUG:teuthology.parallel:result is None 2023-08-15T16:27:01.688 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-08-15T16:27:01.689 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-15T16:27:01.722 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-08-15T16:27:01.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-08-15T16:27:01.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-15T16:27:01.777 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-08-15T16:27:01.906 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-08-15T16:27:01.906 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-08-15T16:27:01.912 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-08-15T16:27:01.913 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-08-15T16:27:01.918 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-08-15T16:27:01.919 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-15T16:27:01.919 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-08-15T16:27:01.919 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-08-15T16:27:01.920 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-15T16:27:01.920 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-08-15T16:27:01.920 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-15T16:27:01.920 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-15T16:27:01.921 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-15T16:27:01.921 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-15T16:27:01.921 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-08-15T16:27:01.922 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-08-15T16:27:01.924 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-08-15T16:27:01.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:27:02.061 INFO:teuthology.dispatcher.supervisor:Running job 7368284 2023-08-15T16:27:02.061 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368284 --name yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} -- /home/teuthworker/archive/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368284/orig.config.yaml 2023-08-15T16:27:02.065 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368284 2023-08-15T16:27:02.066 INFO:teuthology.dispatcher.supervisor:Job PID: 28192 2023-08-15T16:27:02.066 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-15T16:29:02.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:31:02.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:33:02.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:35:02.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:37:02.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:39:02.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:41:03.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:43:03.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-15T16:43:03.405 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-15T16:43:03.485 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-08-15T16:43:03.532 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com