2023-12-07T22:07:05.997 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T22:07:05.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:07:06.105 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4766d8550>, signals=[15]) 2023-12-07T22:07:06.105 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-12-07T22:07:06.106 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-12-07T22:07:06.106 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-12-07T22:07:06.232 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-07T22:07:06.278 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of ubuntu 22.04 2023-12-07T22:07:06.580 INFO:teuthology.orchestra.console.smithi031:Power off 2023-12-07T22:07:06.580 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T22:07:06.602 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-12-07T22:07:06.602 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:06.624 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-07T22:07:10.628 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:10.736 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-07T22:07:14.741 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:14.849 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-07T22:07:18.853 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:18.964 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-07T22:07:19.065 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-12-07T22:07:19.166 INFO:teuthology.orchestra.console.smithi031:Power on 2023-12-07T22:07:19.166 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-07T22:07:19.186 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-12-07T22:07:19.187 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:19.207 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-07T22:07:23.210 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:23.319 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-12-07T22:07:27.322 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T22:07:27.431 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-12-07T22:07:27.531 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-12-07T22:07:27.632 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-12-07T22:10:13.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T22:10:43.953 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-12-07T22:11:47.957 WARNING:teuthology.provision.fog.smithi031:timed out 2023-12-07T22:11:53.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T22:11:53.961 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-12-07T22:11:59.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T22:12:00.994 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-12-07T22:12:05.350 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-12-07T22:12:06.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T22:12:07.206 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-07T22:12:07.206 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-07T22:12:07.752 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-12-07T22:12:07.752 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-12-07T22:12:07.799 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-12-07T22:12:07.800 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-12-07T22:12:07.847 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-12-07T22:12:07.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-12-07T22:12:07.966 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-12-07T22:12:07.981 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-12-07T22:12:08.036 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-12-07T22:12:08.095 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-12-07T22:12:08.154 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-12-07T22:12:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-07T22:12:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-12-07T22:12:08.207 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2023-12-07T22:12:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-07T22:12:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2023-12-07T22:12:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-12-07T22:12:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-12-07T22:12:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-07T22:12:08.208 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-07T22:12:08.209 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-07T22:12:08.209 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-07T22:12:08.209 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2023-12-07T22:12:08.210 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-12-07T22:12:08.212 DEBUG:teuthology.parallel:result is None 2023-12-07T22:12:08.381 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-12-07T22:12:08.382 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-07T22:12:08.410 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-12-07T22:12:08.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-07T22:12:08.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T22:12:08.488 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-12-07T22:12:08.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-12-07T22:12:08.585 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-12-07T22:12:08.633 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-12-07T22:12:08.634 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-12-07T22:12:08.686 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-07T22:12:08.686 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-12-07T22:12:08.686 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2023-12-07T22:12:08.686 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-07T22:12:08.686 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2023-12-07T22:12:08.686 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-12-07T22:12:08.687 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-12-07T22:12:08.687 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-07T22:12:08.687 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-07T22:12:08.687 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-07T22:12:08.687 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-07T22:12:08.687 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2023-12-07T22:12:08.687 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-12-07T22:12:08.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:12:08.816 INFO:teuthology.dispatcher.supervisor:Running job 7482394 2023-12-07T22:12:08.816 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-07_21:35:03-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7482394 --name yuriw-2023-12-07_21:35:03-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-12-07_21:35:03-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7482394/orig.config.yaml 2023-12-07T22:12:08.819 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-07_21:35:03-rados-wip-yuri3-testing-2023-12-07-0727-distro-default-smithi/7482394 2023-12-07T22:12:08.820 INFO:teuthology.dispatcher.supervisor:Job PID: 3374461 2023-12-07T22:12:08.820 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-07T22:14:08.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:16:09.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:18:09.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:20:09.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:22:09.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:24:09.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:26:09.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:28:10.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:30:10.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:32:10.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T22:32:10.517 INFO:teuthology.dispatcher.supervisor:Success! 2023-12-07T22:32:10.665 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-12-07T22:32:10.717 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com