2023-08-23T00:11:57.105 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T00:11:57.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:11:57.220 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff80120d310>, signals=[15]) 2023-08-23T00:11:57.221 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-08-23T00:11:57.222 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T00:11:57.222 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-08-23T00:11:57.244 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /host {"name": "smithi162"} 2023-08-23T00:11:57.312 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-23T00:11:57.359 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-23T00:11:57.360 DEBUG:teuthology.provision.fog.smithi162:FOG request: PUT /host/267 {"imageID": 6} 2023-08-23T00:11:57.405 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of ubuntu 22.04 2023-08-23T00:11:57.405 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:11:57.490 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T00:11:57.528 DEBUG:teuthology.provision.fog.smithi162:FOG request: POST /host/267/task {"taskTypeID": 1} 2023-08-23T00:11:57.595 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:11:57.713 INFO:teuthology.orchestra.console.smithi162:Power off 2023-08-23T00:11:57.714 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T00:11:57.738 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-08-23T00:11:57.739 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:11:57.769 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-08-23T00:12:01.773 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:12:01.884 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-08-23T00:12:05.888 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:12:05.998 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-08-23T00:12:10.000 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:12:10.111 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-23T00:12:10.212 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-08-23T00:12:10.313 INFO:teuthology.orchestra.console.smithi162:Power on 2023-08-23T00:12:10.313 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T00:12:10.338 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2023-08-23T00:12:10.339 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:12:10.363 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-23T00:12:14.368 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:12:14.484 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-08-23T00:12:18.488 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T00:12:18.597 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-08-23T00:12:18.698 INFO:teuthology.orchestra.console.smithi162:Power on completed 2023-08-23T00:12:18.799 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-08-23T00:12:18.800 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:12:33.908 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:12:48.992 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:13:04.087 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:13:19.168 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:13:34.276 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:13:49.356 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:14:04.456 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:14:19.540 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:14:34.636 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:14:49.732 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:15:04.808 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:15:19.898 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:15:34.976 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:15:50.060 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-08-23T00:15:50.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:15:53.200 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:15:59.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:16:02.256 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:16:08.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:16:11.316 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:16:17.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:16:20.400 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:16:26.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:16:29.460 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:16:35.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:16:38.544 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:16:44.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:16:47.632 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:16:53.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:12.048 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:18.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:21.108 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:27.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:27.114 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:33.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:33.122 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:39.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:39.130 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:45.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:45.138 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:51.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:51.146 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-08-23T00:17:57.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:57.343 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T00:17:57.344 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T00:17:57.799 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-08-23T00:17:57.800 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2023-08-23T00:17:57.846 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2023-08-23T00:17:57.847 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2023-08-23T00:17:57.894 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-08-23T00:17:57.895 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-08-23T00:17:58.103 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2023-08-23T00:17:58.119 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2023-08-23T00:17:58.175 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2023-08-23T00:17:58.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-08-23T00:17:58.302 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-08-23T00:17:58.356 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-23T00:17:58.356 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-08-23T00:17:58.356 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-08-23T00:17:58.356 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:17:58.357 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-08-23T00:17:58.358 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2023-08-23T00:17:58.373 DEBUG:teuthology.parallel:result is None 2023-08-23T00:17:58.500 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2023-08-23T00:17:58.501 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T00:17:58.526 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2023-08-23T00:17:58.527 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-08-23T00:17:58.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:17:58.645 DEBUG:teuthology.orchestra.run.smithi162:> true 2023-08-23T00:17:58.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2023-08-23T00:17:58.748 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2023-08-23T00:17:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2023-08-23T00:17:58.797 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-08-23T00:17:58.845 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-23T00:17:58.845 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-08-23T00:17:58.846 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-08-23T00:17:58.846 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-23T00:17:58.846 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-08-23T00:17:58.846 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-08-23T00:17:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-08-23T00:17:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:17:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:17:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:17:58.847 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:17:58.848 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-08-23T00:17:58.848 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-08-23T00:17:58.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:17:58.962 INFO:teuthology.dispatcher.supervisor:Running job 7376937 2023-08-23T00:17:58.962 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376937 --name yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376937/orig.config.yaml 2023-08-23T00:17:58.966 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-22_18:16:03-rados-wip-yuri10-testing-2023-08-17-1444-distro-default-smithi/7376937 2023-08-23T00:17:58.967 INFO:teuthology.dispatcher.supervisor:Job PID: 5791 2023-08-23T00:17:58.968 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-23T00:19:59.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:21:59.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:23:59.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:25:59.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:27:59.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:29:59.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:32:00.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:34:00.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:36:00.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:38:00.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:38:00.671 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T00:38:00.779 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-08-23T00:38:00.827 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com