2024-02-11T22:07:37.541 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-11T22:07:37.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:07:37.652 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcaaa32cc10>, signals=[15]) 2024-02-11T22:07:37.652 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2024-02-11T22:07:37.653 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2024-02-11T22:07:37.653 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-11T22:07:37.790 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-11T22:07:37.837 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 22.04 2024-02-11T22:07:38.092 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-11T22:07:38.092 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-11T22:07:38.113 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-11T22:07:38.114 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:38.134 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-11T22:07:42.139 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:42.249 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-11T22:07:46.252 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:46.361 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-11T22:07:50.366 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:50.475 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-11T22:07:50.575 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-11T22:07:50.676 INFO:teuthology.orchestra.console.smithi099:Power on 2024-02-11T22:07:50.676 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-11T22:07:50.698 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2024-02-11T22:07:50.698 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:50.718 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-11T22:07:54.722 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:54.830 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-11T22:07:58.835 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-11T22:07:58.944 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-11T22:07:59.044 INFO:teuthology.orchestra.console.smithi099:Power on completed 2024-02-11T22:07:59.145 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2024-02-11T22:11:15.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:11:18.332 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:11:24.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:11:27.388 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:11:33.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:11:36.448 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:11:42.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:11:45.532 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:11:51.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:11:54.588 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:12:00.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:12:03.644 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:12:09.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:12:41.149 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:12:47.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:12:47.155 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:12:53.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:12:53.164 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:12:59.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:12:59.173 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-11T22:13:05.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:13:05.395 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-11T22:13:05.396 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-11T22:13:05.843 INFO:teuthology.provision.fog.smithi099:Node is ready 2024-02-11T22:13:05.844 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2024-02-11T22:13:05.892 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2024-02-11T22:13:05.892 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2024-02-11T22:13:05.940 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2024-02-11T22:13:05.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-11T22:13:06.118 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2024-02-11T22:13:06.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2024-02-11T22:13:06.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2024-02-11T22:13:06.243 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2024-02-11T22:13:06.302 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-11T22:13:06.347 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-11T22:13:06.347 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-02-11T22:13:06.347 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-11T22:13:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-02-11T22:13:06.349 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2024-02-11T22:13:06.350 DEBUG:teuthology.parallel:result is None 2024-02-11T22:13:06.481 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2024-02-11T22:13:06.482 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-11T22:13:06.504 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2024-02-11T22:13:06.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-11T22:13:06.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-11T22:13:06.580 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-11T22:13:06.680 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-11T22:13:06.680 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-11T22:13:06.731 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-11T22:13:06.731 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-11T22:13:06.784 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-11T22:13:06.785 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-11T22:13:06.785 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-02-11T22:13:06.785 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-11T22:13:06.802 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:13:06.901 INFO:teuthology.dispatcher.supervisor:Running job 7539906 2024-02-11T22:13:06.902 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2024-01-31_07:15:30-rados-wip-nitzan-max-pglog-size-distro-default-smithi/7539906 --name nmordech-2024-01-31_07:15:30-rados-wip-nitzan-max-pglog-size-distro-default-smithi --description rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} -- /home/teuthworker/archive/nmordech-2024-01-31_07:15:30-rados-wip-nitzan-max-pglog-size-distro-default-smithi/7539906/orig.config.yaml 2024-02-11T22:13:06.904 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2024-01-31_07:15:30-rados-wip-nitzan-max-pglog-size-distro-default-smithi/7539906 2024-02-11T22:13:06.905 INFO:teuthology.dispatcher.supervisor:Job PID: 2996537 2024-02-11T22:13:06.905 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-11T22:15:07.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:17:07.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:19:07.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:21:07.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:23:07.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:25:07.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:27:08.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:29:08.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:31:08.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-11T22:31:08.450 INFO:teuthology.dispatcher.supervisor:Success! 2024-02-11T22:31:08.551 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2024-02-11T22:31:08.598 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com