2023-12-26T12:42:10.556 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-26T12:42:10.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T12:42:10.694 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f175d97e940>, signals=[15]) 2023-12-26T12:42:10.695 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-12-26T12:42:10.695 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T12:42:10.695 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-26T12:42:10.920 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-12-26T12:42:10.977 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of ubuntu 22.04 2023-12-26T12:42:11.869 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-26T12:42:11.869 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T12:42:11.890 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-26T12:42:11.890 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:42:11.910 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-26T12:42:12.011 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-26T12:42:12.112 INFO:teuthology.orchestra.console.smithi088:Power on 2023-12-26T12:42:12.112 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T12:42:12.134 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-12-26T12:42:12.134 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:42:12.153 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-26T12:42:16.158 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:42:16.267 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-26T12:42:20.273 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T12:42:20.383 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-26T12:42:20.484 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-12-26T12:42:20.585 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-12-26T12:51:54.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:51:57.266 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:03.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:52:06.357 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:12.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:52:15.445 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:21.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:52:24.529 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:30.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:52:33.585 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:39.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:52:42.673 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:48.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:52:51.729 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-26T12:52:57.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:53:57.795 WARNING:teuthology.provision.fog.smithi088:timed out 2023-12-26T12:54:03.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:04.012 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T12:54:04.012 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T12:54:04.944 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-12-26T12:54:04.944 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-12-26T12:54:04.993 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-12-26T12:54:04.993 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-12-26T12:54:05.042 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-12-26T12:54:05.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-12-26T12:54:05.146 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-12-26T12:54:05.160 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-12-26T12:54:05.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-12-26T12:54:05.272 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-12-26T12:54:05.329 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-12-26T12:54:05.378 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-26T12:54:05.379 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-26T12:54:05.379 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-26T12:54:05.379 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-26T12:54:05.379 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2023-12-26T12:54:05.380 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-12-26T12:54:05.381 DEBUG:teuthology.parallel:result is None 2023-12-26T12:54:05.560 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-12-26T12:54:05.561 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T12:54:05.586 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-12-26T12:54:05.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-26T12:54:05.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T12:54:05.660 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-26T12:54:05.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-26T12:54:05.762 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-12-26T12:54:05.808 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-12-26T12:54:05.808 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-26T12:54:05.856 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-26T12:54:05.857 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-26T12:54:05.858 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-26T12:54:05.858 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2023-12-26T12:54:05.858 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-26T12:54:05.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T12:54:05.973 INFO:teuthology.dispatcher.supervisor:Running job 7501120 2023-12-26T12:54:05.973 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi/7501120 --name rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi --description rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} -- /home/teuthworker/archive/rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi/7501120/orig.config.yaml 2023-12-26T12:54:05.977 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-12-26_12:40:04-rados-wip-rf-be-error-distro-default-smithi/7501120 2023-12-26T12:54:05.977 INFO:teuthology.dispatcher.supervisor:Job PID: 619401 2023-12-26T12:54:05.977 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-26T12:56:06.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T12:58:06.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:00:06.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:02:06.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:04:06.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:06:07.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:08:07.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:10:07.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:12:07.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:14:07.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:16:07.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:18:08.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:20:08.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:22:08.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T13:22:08.451 INFO:teuthology.dispatcher.supervisor:Success! 2023-12-26T13:22:08.603 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-12-26T13:22:08.648 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com