2023-10-27T13:55:11.842 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-27T13:55:11.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T13:55:11.958 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4f0ffe8670>, signals=[15]) 2023-10-27T13:55:11.959 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-10-27T13:55:11.960 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-10-27T13:55:11.960 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-10-27T13:55:11.988 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-10-27T13:55:12.063 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-27T13:55:12.117 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-27T13:55:12.118 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 6} 2023-10-27T13:55:12.165 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of ubuntu 22.04 2023-10-27T13:55:12.165 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:55:12.230 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-10-27T13:55:12.272 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-10-27T13:55:12.344 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:55:12.458 INFO:teuthology.orchestra.console.smithi089:Power off 2023-10-27T13:55:12.459 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-27T13:55:12.483 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-10-27T13:55:12.483 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:55:12.504 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-27T13:55:16.509 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:55:16.617 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-27T13:55:20.622 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:55:20.730 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-27T13:55:24.734 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:55:24.843 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-10-27T13:55:24.944 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-10-27T13:55:25.045 INFO:teuthology.orchestra.console.smithi089:Power on 2023-10-27T13:55:25.045 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-27T13:55:25.065 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On 2023-10-27T13:55:25.066 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:55:25.085 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-10-27T13:55:29.090 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-27T13:55:29.199 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-27T13:55:29.300 INFO:teuthology.orchestra.console.smithi089:Power on completed 2023-10-27T13:55:29.401 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-10-27T13:55:29.401 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:55:44.486 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:55:59.578 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:56:14.686 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:56:29.778 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:56:44.852 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:56:59.930 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:57:14.998 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:57:30.079 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:57:45.162 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:58:00.266 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:58:15.350 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:58:30.441 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:58:45.522 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-10-27T13:58:45.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T13:59:04.058 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-27T13:59:10.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T13:59:13.150 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-27T13:59:19.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T13:59:22.237 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-27T13:59:28.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T13:59:31.326 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-10-27T13:59:37.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:00:37.363 WARNING:teuthology.provision.fog.smithi089:timed out 2023-10-27T14:00:43.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:00:43.677 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-27T14:00:43.681 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-27T14:00:44.121 INFO:teuthology.provision.fog.smithi089:Node is ready 2023-10-27T14:00:44.121 DEBUG:teuthology.orchestra.run.smithi089:> hostname 2023-10-27T14:00:44.168 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2023-10-27T14:00:44.169 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts 2023-10-27T14:00:44.217 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2023-10-27T14:00:44.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-10-27T14:00:44.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts 2023-10-27T14:00:44.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts 2023-10-27T14:00:44.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname 2023-10-27T14:00:44.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089 2023-10-27T14:00:44.535 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-10-27T14:00:44.584 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-27T14:00:44.584 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-10-27T14:00:44.585 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2023-10-27T14:00:44.585 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-27T14:00:44.585 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2023-10-27T14:00:44.585 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-10-27T14:00:44.585 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-10-27T14:00:44.586 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-27T14:00:44.586 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-27T14:00:44.586 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-27T14:00:44.586 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-27T14:00:44.586 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2023-10-27T14:00:44.587 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2023-10-27T14:00:44.589 DEBUG:teuthology.parallel:result is None 2023-10-27T14:00:44.709 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2023-10-27T14:00:44.710 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-27T14:00:44.734 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2023-10-27T14:00:44.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-27T14:00:44.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-27T14:00:44.803 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-27T14:00:44.895 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-27T14:00:44.895 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-10-27T14:00:44.940 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-10-27T14:00:44.941 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-10-27T14:00:44.993 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-27T14:00:44.993 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-10-27T14:00:44.993 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="22.04" 2023-10-27T14:00:44.993 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-27T14:00:44.994 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=jammy 2023-10-27T14:00:44.994 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-10-27T14:00:44.994 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-10-27T14:00:44.994 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-27T14:00:44.994 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-27T14:00:44.995 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-27T14:00:44.995 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-27T14:00:44.995 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=jammy 2023-10-27T14:00:44.995 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-10-27T14:00:45.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:00:45.108 INFO:teuthology.dispatcher.supervisor:Running job 7436633 2023-10-27T14:00:45.108 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_sjust@teuthology --archive /home/teuthworker/archive/sjust-2023-10-25_06:27:04-rados-wip-crimson-scrub-testing-2023-10-24-distro-default-smithi/7436633 --name sjust-2023-10-25_06:27:04-rados-wip-crimson-scrub-testing-2023-10-24-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} -- /home/teuthworker/archive/sjust-2023-10-25_06:27:04-rados-wip-crimson-scrub-testing-2023-10-24-distro-default-smithi/7436633/orig.config.yaml 2023-10-27T14:00:45.111 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sjust-2023-10-25_06:27:04-rados-wip-crimson-scrub-testing-2023-10-24-distro-default-smithi/7436633 2023-10-27T14:00:45.112 INFO:teuthology.dispatcher.supervisor:Job PID: 1710465 2023-10-27T14:00:45.112 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-27T14:02:45.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:04:45.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:06:45.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:08:45.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:10:45.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:12:46.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:14:46.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:16:46.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:18:46.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-27T14:18:46.644 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-27T14:18:46.728 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-10-27T14:18:46.853 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com