2024-02-14T16:36:39.745 INFO:root:teuthology version: 0.0.1.dev258+g9e44c16 2024-02-14T16:36:39.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:36:39.857 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4514c0fc10>, signals=[15]) 2024-02-14T16:36:39.858 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-02-14T16:36:39.858 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T16:36:39.858 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-14T16:36:39.973 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-02-14T16:36:40.016 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 22.04 2024-02-14T16:36:40.329 INFO:teuthology.orchestra.console.smithi136:Power off 2024-02-14T16:36:40.329 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T16:36:40.350 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-02-14T16:36:40.351 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:36:40.373 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-14T16:36:40.474 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-02-14T16:36:40.574 INFO:teuthology.orchestra.console.smithi136:Power on 2024-02-14T16:36:40.574 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T16:36:40.598 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-02-14T16:36:40.599 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:36:40.619 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-14T16:36:44.623 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:36:44.731 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-14T16:36:48.736 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T16:36:48.845 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-14T16:36:48.946 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-02-14T16:36:49.046 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-02-14T16:40:07.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:40:26.172 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:40:32.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:40:35.228 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:40:41.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:40:44.316 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:40:50.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:40:53.404 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:40:59.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:02.460 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:41:08.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:39.901 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:41:45.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:45.910 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:41:51.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:51.918 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:41:57.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:41:57.927 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:42:03.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:03.935 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-14T16:42:09.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:10.389 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T16:42:10.389 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T16:42:10.959 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-02-14T16:42:10.960 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-02-14T16:42:11.007 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2024-02-14T16:42:11.008 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2024-02-14T16:42:11.056 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2024-02-14T16:42:11.057 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-14T16:42:11.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2024-02-14T16:42:11.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2024-02-14T16:42:11.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2024-02-14T16:42:11.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-14T16:42:11.370 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-14T16:42:11.419 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:42:11.419 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2024-02-14T16:42:11.419 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2024-02-14T16:42:11.419 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:42:11.420 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:42:11.421 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-02-14T16:42:11.422 DEBUG:teuthology.parallel:result is None 2024-02-14T16:42:11.573 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-02-14T16:42:11.573 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T16:42:11.608 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-02-14T16:42:11.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-14T16:42:11.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T16:42:11.684 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-02-14T16:42:11.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-14T16:42:11.784 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-02-14T16:42:11.831 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-02-14T16:42:11.831 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-14T16:42:11.879 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-14T16:42:11.880 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-14T16:42:11.880 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-14T16:42:11.880 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2024-02-14T16:42:11.880 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-14T16:42:11.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:42:11.986 INFO:teuthology.dispatcher.supervisor:Running job 7559650 2024-02-14T16:42:11.986 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2024-02-14_05:46:01-rados:perf-main-distro-default-smithi/7559650 --name nmordech-2024-02-14_05:46:01-rados:perf-main-distro-default-smithi --description rados:perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} -- /home/teuthworker/archive/nmordech-2024-02-14_05:46:01-rados:perf-main-distro-default-smithi/7559650/orig.config.yaml 2024-02-14T16:42:11.989 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2024-02-14_05:46:01-rados:perf-main-distro-default-smithi/7559650 2024-02-14T16:42:11.989 INFO:teuthology.dispatcher.supervisor:Job PID: 1479605 2024-02-14T16:42:11.989 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-14T16:44:12.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:46:12.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:48:12.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:50:12.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:52:12.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:54:12.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:56:13.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T16:58:13.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T17:00:13.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T17:02:13.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T17:02:13.603 INFO:teuthology.dispatcher.supervisor:Success! 2024-02-14T17:02:13.682 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2024-02-14T17:02:13.745 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com