2023-11-03T14:01:07.735 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T14:01:07.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:01:07.838 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f974733d670>, signals=[15]) 2023-11-03T14:01:07.840 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-11-03T14:01:07.840 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T14:01:07.840 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-11-03T14:01:07.860 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-11-03T14:01:07.926 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-03T14:01:07.976 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-03T14:01:07.976 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 6} 2023-11-03T14:01:08.019 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of ubuntu 22.04 2023-11-03T14:01:08.019 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:01:08.081 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T14:01:08.114 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-11-03T14:01:08.172 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:01:08.267 INFO:teuthology.orchestra.console.smithi057:Power off 2023-11-03T14:01:08.268 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T14:01:08.294 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-11-03T14:01:08.295 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:01:08.319 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-03T14:01:12.322 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:01:12.431 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-03T14:01:16.435 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:01:16.544 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-03T14:01:20.546 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:01:20.655 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-11-03T14:01:20.756 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-11-03T14:01:20.856 INFO:teuthology.orchestra.console.smithi057:Power on 2023-11-03T14:01:20.857 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T14:01:20.881 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-11-03T14:01:20.881 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:01:20.903 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-11-03T14:01:24.906 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T14:01:25.016 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-11-03T14:01:25.117 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-11-03T14:01:25.218 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-11-03T14:01:25.219 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:01:40.290 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:01:55.372 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:02:10.451 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:02:25.522 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:02:40.594 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:02:55.670 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:03:10.750 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:03:25.826 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:03:40.913 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:03:56.006 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:04:11.094 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:04:26.178 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:04:41.258 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:04:56.354 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-11-03T14:04:56.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:04:59.482 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:05.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:05:08.538 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:14.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:05:17.594 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:23.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:05:26.650 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:32.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:05:35.738 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:41.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:05:44.798 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:50.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:05:53.886 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:05:59.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:06:59.950 WARNING:teuthology.provision.fog.smithi057:timed out 2023-11-03T14:07:05.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:07:06.970 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-11-03T14:07:12.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:07:13.208 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T14:07:13.209 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T14:07:13.816 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-11-03T14:07:13.817 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-11-03T14:07:13.863 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-11-03T14:07:13.863 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-11-03T14:07:13.911 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-11-03T14:07:13.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-11-03T14:07:14.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-11-03T14:07:14.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-11-03T14:07:14.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-11-03T14:07:14.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-11-03T14:07:14.227 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-11-03T14:07:14.276 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T14:07:14.276 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-11-03T14:07:14.276 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="22.04" 2023-11-03T14:07:14.276 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T14:07:14.277 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=jammy 2023-11-03T14:07:14.277 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-11-03T14:07:14.277 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-11-03T14:07:14.278 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T14:07:14.278 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T14:07:14.278 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T14:07:14.278 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T14:07:14.278 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=jammy 2023-11-03T14:07:14.279 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-11-03T14:07:14.282 DEBUG:teuthology.parallel:result is None 2023-11-03T14:07:14.420 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-11-03T14:07:14.421 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T14:07:14.443 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-11-03T14:07:14.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-03T14:07:14.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T14:07:14.567 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-11-03T14:07:14.658 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-11-03T14:07:14.658 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-11-03T14:07:14.706 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-11-03T14:07:14.707 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-11-03T14:07:14.754 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T14:07:14.755 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-11-03T14:07:14.755 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="22.04" 2023-11-03T14:07:14.755 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T14:07:14.755 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=jammy 2023-11-03T14:07:14.755 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-11-03T14:07:14.756 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-11-03T14:07:14.756 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T14:07:14.756 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T14:07:14.756 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T14:07:14.756 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T14:07:14.757 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=jammy 2023-11-03T14:07:14.757 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-11-03T14:07:14.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:07:14.883 INFO:teuthology.dispatcher.supervisor:Running job 7445431 2023-11-03T14:07:14.884 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445431 --name sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} -- /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445431/orig.config.yaml 2023-11-03T14:07:14.887 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445431 2023-11-03T14:07:14.888 INFO:teuthology.dispatcher.supervisor:Job PID: 4065716 2023-11-03T14:07:14.888 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T14:09:14.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:11:15.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:13:15.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:15:15.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:17:15.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:19:15.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:21:16.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:23:16.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:25:16.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:27:16.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T14:27:16.605 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T14:27:16.695 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-11-03T14:27:16.738 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com