2023-12-02T04:56:24.925 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-02T04:56:24.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T04:56:25.051 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa1e4d7a550>, signals=[15]) 2023-12-02T04:56:25.051 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-12-02T04:56:25.051 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-12-02T04:56:25.051 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-12-02T04:56:25.189 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-02T04:56:25.234 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of ubuntu 22.04 2023-12-02T04:56:25.469 INFO:teuthology.orchestra.console.smithi023:Power off 2023-12-02T04:56:25.470 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-02T04:56:25.491 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-12-02T04:56:25.491 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T04:56:25.515 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-12-02T04:56:29.519 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T04:56:29.628 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-12-02T04:56:33.630 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T04:56:33.738 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-12-02T04:56:33.839 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-12-02T04:56:33.940 INFO:teuthology.orchestra.console.smithi023:Power on 2023-12-02T04:56:33.940 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-02T04:56:33.960 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2023-12-02T04:56:33.960 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T04:56:33.979 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-12-02T04:56:37.982 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T04:56:38.091 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-12-02T04:56:42.094 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-02T04:56:42.305 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-12-02T04:56:42.406 INFO:teuthology.orchestra.console.smithi023:Power on completed 2023-12-02T04:56:42.506 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-12-02T05:00:13.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:00:13.708 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-02T05:01:17.712 WARNING:teuthology.provision.fog.smithi023:timed out 2023-12-02T05:01:23.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:01:26.786 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-12-02T05:01:32.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:01:35.846 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-12-02T05:01:41.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:01:44.898 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-12-02T05:01:50.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:02:50.902 WARNING:teuthology.provision.fog.smithi023:timed out 2023-12-02T05:02:56.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:02:57.141 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-02T05:02:57.143 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-02T05:02:58.127 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-12-02T05:02:58.128 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-12-02T05:02:58.176 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-12-02T05:02:58.176 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-12-02T05:02:58.224 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-12-02T05:02:58.225 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-12-02T05:02:58.387 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-12-02T05:02:58.401 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-12-02T05:02:58.456 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-12-02T05:02:58.512 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-12-02T05:02:58.568 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="22.04" 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=jammy 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2023-12-02T05:02:58.620 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2023-12-02T05:02:58.621 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-02T05:02:58.621 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-02T05:02:58.621 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-02T05:02:58.621 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-02T05:02:58.621 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=jammy 2023-12-02T05:02:58.621 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-12-02T05:02:58.623 DEBUG:teuthology.parallel:result is None 2023-12-02T05:02:58.753 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-12-02T05:02:58.753 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-02T05:02:58.785 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-12-02T05:02:58.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-12-02T05:02:58.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-02T05:02:58.863 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-12-02T05:02:58.974 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-12-02T05:02:58.975 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-12-02T05:02:59.019 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-12-02T05:02:59.019 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="22.04" 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=jammy 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-02T05:02:59.069 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-02T05:02:59.070 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-02T05:02:59.070 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=jammy 2023-12-02T05:02:59.070 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-12-02T05:02:59.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:02:59.183 INFO:teuthology.dispatcher.supervisor:Running job 7475050 2023-12-02T05:02:59.183 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-01_17:58:18-rados-main-distro-default-smithi/7475050 --name yuriw-2023-12-01_17:58:18-rados-main-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} -- /home/teuthworker/archive/yuriw-2023-12-01_17:58:18-rados-main-distro-default-smithi/7475050/orig.config.yaml 2023-12-02T05:02:59.186 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-01_17:58:18-rados-main-distro-default-smithi/7475050 2023-12-02T05:02:59.186 INFO:teuthology.dispatcher.supervisor:Job PID: 1657961 2023-12-02T05:02:59.186 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-02T05:04:59.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:06:59.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:08:59.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:10:59.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:12:59.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:14:59.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:16:59.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:18:59.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:20:59.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:22:59.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-02T05:22:59.970 INFO:teuthology.dispatcher.supervisor:Success! 2023-12-02T05:23:00.055 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-12-02T05:23:00.102 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com